-- Logs begin at Tue 2022-08-30 23:29:51 UTC, end at Wed 2022-08-31 00:36:44 UTC. -- Aug 31 00:04:53.318996 dv-cinder-852209-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 00:04:53.326472 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:04:53 2022] *** Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: nodename: dv-cinder-852209-8-iscsi Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: machine: x86_64 Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: clock source: unix Aug 31 00:04:53.328386 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: pcre jit disabled Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: detected number of CPU cores: 4 Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: current working directory: / Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: your processes number limit is 47680 Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: your memory page size is 4096 bytes Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: detected max file descriptor number: 2048 Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: lock engine: pthread robust mutexes Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: thunder lock: enabled Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 00:04:53.328887 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:04:53.377881 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: Python main interpreter initialized at 0x56490b3fb9c0 Aug 31 00:04:53.377881 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: python threads support enabled Aug 31 00:04:53.377881 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: your server socket listen backlog is limited to 100 connections Aug 31 00:04:53.377881 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:04:53.378349 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:04:53.378349 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: *** Operational MODE: preforking *** Aug 31 00:04:53.378652 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:04:53.378652 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: spawned uWSGI master process (pid: 81500) Aug 31 00:04:53.379097 dv-cinder-852209-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 31 00:04:53.388582 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: spawned uWSGI worker 1 (pid: 81516, cores: 1) Aug 31 00:04:53.388582 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: spawned uWSGI worker 2 (pid: 81517, cores: 1) Aug 31 00:04:53.388582 dv-cinder-852209-8-iscsi devstack@keystone.service[81500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:04:57.681116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:04:57.681116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: from cryptography.utils import int_from_bytes Aug 31 00:04:57.681931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:04:57.681931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: from cryptography.utils import int_from_bytes Aug 31 00:04:57.683912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:04:57.683912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: from cryptography.utils import int_from_bytes Aug 31 00:04:57.684376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:04:57.684376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: from cryptography.utils import int_from_bytes Aug 31 00:04:57.731847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:04:57.732039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:04:57.732234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] command line args: [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:04:57.732510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:04:57.732690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ================================================================================ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:04:57.732946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] admin_token = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.733023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:04:57.733180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:04:57.733269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] config_dir = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.733371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] command line args: [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:04:57.733449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.733552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] config_source = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.733628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:04:57.733735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] debug = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.733819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ================================================================================ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:04:57.733967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] admin_token = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] config_dir = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] config_source = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.734947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] debug = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_config_append = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.735984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_dir = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_config_append = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_dir = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.736989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.737966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.738897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.739973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] publish_errors = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.740884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] publish_errors = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] standard_threads = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.741893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.742011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.742124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.742236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.742929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] standard_threads = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] use_journal = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] use_json = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] use_stderr = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.743889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] use_syslog = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] use_journal = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] use_json = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.744750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] use_stderr = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.744870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.744985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] use_syslog = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.745097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.745209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:04:57.745320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.745443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.745558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.745670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.745787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.745927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.746978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.747888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.748915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.749935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.750994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.751901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752243 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.752943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.753995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.754906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.755904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.756938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.757977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.758129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.758785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.758917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.759974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.760997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.761895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.762982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.763895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.764949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.765936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.766865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.767900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.768956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.769934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.external = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.external = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.770927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.password = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.token = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.password = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.771992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.token = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.772936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.773940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.774998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.775992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.776949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.777891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.778952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.779895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.780828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.781977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.782912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.783887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.784970 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.785956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.786945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.787888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.788944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.789940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.790883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.791940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.792964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.793879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.794919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.795973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.796902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.797832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.798947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.799995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.800941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.801887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.802948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] role.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.803949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] role.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] role.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] role.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.804878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.805734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.805873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.805991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.806935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.807993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.808892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.809974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.810906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.811964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.812898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.813948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.814796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.815927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.816998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.817816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.818973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.819914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.820030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.820154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.820271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.820387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.820503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.821267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.821391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.821519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.821960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.822085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.822085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:04:57.822303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.822303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.822303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:04:57.822303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:04:57.847430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.847661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.847886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.848268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.848503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.848734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.856147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.858760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.884899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.885129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.886017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.886256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.938061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.938200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.986574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.986805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.987655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:57.987889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.141272 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.141499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.141721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.141968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.142186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.142397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.144738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.144976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.145204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.145428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.145646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.145881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.165593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.165821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.166066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.166281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.166493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.166702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.166917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.167973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.168219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.168450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.168804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.169036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.170223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.170471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.177627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.178046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.190683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.190869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.191950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.192035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.192205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.192425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.192644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:04:58.212182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.212389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:04:58.212731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.212930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:04:58.213200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.213457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.213711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.213865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.214092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:04:58.214273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.217819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.218073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:04:58.218368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.218817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.219702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.220049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.224398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.224678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.224949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.225231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.232257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.232542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.232817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.233102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.236949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.240104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.242050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.242335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.243129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.243412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.243547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.243709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.243835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.243948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.244968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.245051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.245235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.245325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.245514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.245924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.246210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.246486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.268285 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.269582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.269742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.270047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.271088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.271376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.274579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.274863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.275143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.276081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.276369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.276654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.281543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.281872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.283025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.283315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.285743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.286056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.286369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.286660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.286937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.287394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.287691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.287978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.288266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.288545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.288826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.288914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.289103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.289185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.289410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.289492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.305424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.305968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.307170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.307450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.309811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.311331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.312904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.313196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.314586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.314884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.317507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.319089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.321211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.322776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.324306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.324605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.324889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.325171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.325551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.325832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.326007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.326314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.326603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.326893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.327185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.327470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.341512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.341803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.342093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.342353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.343306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.343599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.343880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.344133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.349038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.350715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.351070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.352274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.352549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.352633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.354205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.354485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.355206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.355491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.355774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.356059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.356353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.357133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.357423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.357829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.358146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.358441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.368018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.368300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.368580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.368859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.369138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.369411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.369701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.370135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.370425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.370806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.371094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.371385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.371670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.371978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.385020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.387438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.388042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.390390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.390926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.392360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.393246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.393831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.394133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.394431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.394703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.396310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.396597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.396903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.401657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.403141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.403860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.405347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.406012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.406303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.406584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.406855 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.408383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.408686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.408974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.409253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.414830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.415115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.415395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.417149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.417444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.417730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.422269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.422555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.422835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.423120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.423392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.423663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.423946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.424219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.424493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.424657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:04:58.424764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.424947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.425906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.426107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.426388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.426666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.426946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.427224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.427499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.427764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.428033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.428316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:04:58.460237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56490b3fb9c0 pid: 81516 (default app) Aug 31 00:04:58.463742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56490b3fb9c0 pid: 81517 (default app) Aug 31 00:04:58.464355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a62f-4900-4634-a44f-c7f0f056aefa None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:04:58.464680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a62f-4900-4634-a44f-c7f0f056aefa None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:04:58.465001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a62f-4900-4634-a44f-c7f0f056aefa None None] PATH_INFO: `/v3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:04:58.469188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed Aug 31 00:04:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:05.038315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:05.038809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:05.038912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:05.044006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:05.049173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:05.049705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:05.049705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:05.119547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: INFO dbcounter [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] Registered counter for database keystone Aug 31 00:05:05.138210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:05:05.144320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writer thread running {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:05:05.321810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG passlib.handlers.bcrypt [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81516) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:05:05.322271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG passlib.handlers.bcrypt [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81516) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:05:05.380344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:05.381897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:05.508832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:05:05.951070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:06.020322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: INFO dbcounter [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] Registered counter for database keystone Aug 31 00:05:06.041086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG oslo_db.sqlalchemy.engines [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:05:06.047267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writer thread running {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:05:06.166374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2267673-2545-42ef-8eb0-2b1ebf52d871 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:06.170623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:06.171241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:06.171521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:06.171793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:06.179784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:06.234426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:05:06.234776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e799109-67f6-4ce5-98c5-b72bb074cedf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:06.244911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 31 00:05:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:05:06.250969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:06.265182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad33ef-5325-4c52-b427-927a648394cd None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:06.269584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:06.270713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:06.270995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:06.271266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] PATH_INFO: `/v3/projects/bd522a8547c94161b0d64079ee82f079` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:06.272836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] RBAC: Authorizing `identity:get_project(project_id=bd522a8547c94161b0d64079ee82f079)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:06.328991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING keystone.common.rbac_enforcer.enforcer [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:05:06.329346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f1fbb-1c13-43cd-ace2-c19067ee9d0e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:06.333959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Aug 31 00:05:06 2022] GET /identity/v3/projects/bd522a8547c94161b0d64079ee82f079 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:08.204771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc346-27f3-444e-8d80-e29582c0b7df None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:08.205265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc346-27f3-444e-8d80-e29582c0b7df None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:08.205265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc346-27f3-444e-8d80-e29582c0b7df None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:08.209347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:08.215784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6b35-177b-4789-930f-26e390613362 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:08.216189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6b35-177b-4789-930f-26e390613362 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:08.216335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6b35-177b-4789-930f-26e390613362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:08.236989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-614e6b35-177b-4789-930f-26e390613362 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:08.238539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-614e6b35-177b-4789-930f-26e390613362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:08.246348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:05:08.532903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc346-27f3-444e-8d80-e29582c0b7df None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:08.545550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc346-27f3-444e-8d80-e29582c0b7df None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:08.549746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81345eff-bd23-48e6-a999-e98c5076f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:08.550374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345eff-bd23-48e6-a999-e98c5076f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:08.550655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345eff-bd23-48e6-a999-e98c5076f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:08.550929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345eff-bd23-48e6-a999-e98c5076f2fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:08.559369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81345eff-bd23-48e6-a999-e98c5076f2fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:08.561140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81345eff-bd23-48e6-a999-e98c5076f2fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:08.569778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 31 00:05:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:05:08.575019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6b35-177b-4789-930f-26e390613362 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:08.583960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6b35-177b-4789-930f-26e390613362 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:08.588365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9a46-9ad0-48bd-a1af-ff1c9fe168e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:08.588988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9a46-9ad0-48bd-a1af-ff1c9fe168e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:08.589270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9a46-9ad0-48bd-a1af-ff1c9fe168e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:08.589545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9a46-9ad0-48bd-a1af-ff1c9fe168e2 admin admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:08.590899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9a46-9ad0-48bd-a1af-ff1c9fe168e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:08.592739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d9a46-9ad0-48bd-a1af-ff1c9fe168e2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:08.594320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed Aug 31 00:05:08 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:10.535291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7200-52f9-4380-bb77-dacafcbc2ca6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:10.535855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7200-52f9-4380-bb77-dacafcbc2ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:10.535855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d7200-52f9-4380-bb77-dacafcbc2ca6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:10.537151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:10.542313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:10.542708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:10.542943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:10.561333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:10.562542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:10.567706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2111-3080-45dc-ba79-630554326e39 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:10.567989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2111-3080-45dc-ba79-630554326e39 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:10.568264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2111-3080-45dc-ba79-630554326e39 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:10.569563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:10.575081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:10.575364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:10.575636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:10.616502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG passlib.handlers.bcrypt [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81517) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:05:10.616899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG passlib.handlers.bcrypt [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81517) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:05:10.643458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:10.666771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:10.668343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:10.764819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:10.907638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:10.931847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.011350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a358a7-eebd-4964-a7b0-2d8a032289d1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.031758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.043794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.044425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.044700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.044971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.056799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:11.065518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:11.066508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:11.067336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:11.072347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.131798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7965f-99cf-449f-9637-56f4b5fc898b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.134574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.151882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.170196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7ded7-c13d-48d1-84f5-931dfd60cf0b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.170581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.171442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.171721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.171996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.204592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.205193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.205475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.205747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.206447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:11.206754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.208144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.219749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:11.225201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.237625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.239255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.322542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb6d5-0404-4085-9bde-a1c6f0a6c598 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.335678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:11.341699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.344331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.356578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.357213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.357494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.357769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.359007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.360467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.362532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:11.368244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.382192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.438902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f93c8-8706-4c0e-9bf5-a4d140a3b5bf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.467001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f615ad-427f-41ee-9ce3-0c21c67db3cf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.471667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.472512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.472787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.473058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.491465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.492977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.501183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.501794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.502145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.502420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.503519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.504945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.506506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:11.511022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:11.511983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:11.512784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:11.512784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:11.512784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:11.512784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:11.513004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.517518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:11.573085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.594605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:11.614141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174af23d-e97e-41d2-b96e-1255b2d5e127 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.618857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cbbd3-33ab-4fda-a296-8f58a6d1e812 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:11.648237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.648796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.649071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.649337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.650075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.domain.id=default, user.id=35b61985750d49d482576c7757bd67fa) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:11.650377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.651799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a076b43-287a-4f66-92d7-7a02eae390b6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.652728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:11.653335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:11.653617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:11.653932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:11.654579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:11.654883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:11.656259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5582-3f5d-4d5d-b22d-05d21d412f66 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:11.658467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/role_assignments?user.id=35b61985750d49d482576c7757bd67fa&scope.domain.id=default&role.id=7c753c584d524b31b4742805d7365f68 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:11.675421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:13.762818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735924-f541-4d6e-9cdd-cf95da23b854 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:13.763344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735924-f541-4d6e-9cdd-cf95da23b854 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:13.763344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1735924-f541-4d6e-9cdd-cf95da23b854 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:13.764873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:13.777005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eeb97-07e2-4826-994f-2f3ae4820219 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:13.777803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eeb97-07e2-4826-994f-2f3ae4820219 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:13.778254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eeb97-07e2-4826-994f-2f3ae4820219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:13.802800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fd2eeb97-07e2-4826-994f-2f3ae4820219 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:13.804246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fd2eeb97-07e2-4826-994f-2f3ae4820219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:13.909876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:14.025870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bd4a6-20bd-4dc7-b2f9-60395752405a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.026488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bd4a6-20bd-4dc7-b2f9-60395752405a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.026985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bd4a6-20bd-4dc7-b2f9-60395752405a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.028509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:14.033722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.034037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.034315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.062857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:14.064056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:14.067774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544885-8d1b-4312-b707-b5044ede2e8d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.068293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544885-8d1b-4312-b707-b5044ede2e8d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.068758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544885-8d1b-4312-b707-b5044ede2e8d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.070931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 14/25] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:14.076642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.077144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.077608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.118864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:14.120411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:14.128966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:14.180276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:14.244645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 00:05:14.346034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:14.473771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f070d-1d5a-4adf-97bb-a0b929c630da None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:14.521325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:14.521986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.522266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.522539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.537976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:14.540091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f36c8485-fa4a-4799-a952-d15da4b59fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:14.562214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:14.563081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:14.563873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:14.563873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:14.563873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:14.563873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 13/28] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:14.569140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:14.592625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500be32-8254-4fda-9540-0636234d8979 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.592906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500be32-8254-4fda-9540-0636234d8979 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.593187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500be32-8254-4fda-9540-0636234d8979 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.594557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 14/29] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:14.599659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.599879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.600225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.627091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:14.628485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:14.676775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:14.707195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:14.742679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:14.743309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:14.761004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c145d-a8c1-42b3-b4b5-2ee6940ead49 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:14.812438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:14.813081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.813321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.813585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.814267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:14.814571 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:14.819637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:14.844181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:14.844756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:14.916488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ea1dd-c281-4a4f-9cfc-a0f5d8f660e8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:14.985752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:14.986742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:14.987233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:14.987706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:14.988590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:14.990205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:15.025218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe8ed6-9517-4bb9-8e46-89ff2f6df4df None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:15.071903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:15.072592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.072877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.073155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.079225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:15.091395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:15.097007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:15.097862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:15.098630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 17/32] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:15.100045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.122218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 16/33] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 00:05:14 2022] POST /identity/v3/roles => generated 219 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:15.123661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.150699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:15.235788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e291637-22ff-41ca-877d-c5419736115a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:15.273103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:15.274210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.275304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.275827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.276898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:15.278736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:15.279118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdafe2-1cff-47b8-8c56-7ead54da06db None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:15.305600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 00:05:15 2022] POST /identity/v3/roles => generated 225 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:15.307599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.358169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41dc63-784b-4bf2-aae1-3efd928baa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:15.358796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dc63-784b-4bf2-aae1-3efd928baa2a None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.359126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dc63-784b-4bf2-aae1-3efd928baa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.359400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dc63-784b-4bf2-aae1-3efd928baa2a None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.360476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dc63-784b-4bf2-aae1-3efd928baa2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:15.362394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dc63-784b-4bf2-aae1-3efd928baa2a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:15.431492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:15.460218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd410bd4-2b5f-43dd-a394-5ba4746e4c44 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:15.500716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:15.501380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.501664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.502017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.502753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:15.503092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:15.504659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85d18-aeca-43c4-a98b-bc4a601e89c8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:15.519577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 18/35] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:15.520958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81418519-a974-4a29-a354-df175fb8f1ab None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.521244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81418519-a974-4a29-a354-df175fb8f1ab None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.524309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81418519-a974-4a29-a354-df175fb8f1ab None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.524889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:15.527567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:05:15 2022] POST /identity/v3/projects => generated 301 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:15.529446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81418519-a974-4a29-a354-df175fb8f1ab None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.530539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.530912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.531196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.553007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:15.554895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:15.615592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:15.654401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 19/38] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:15.684523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81418519-a974-4a29-a354-df175fb8f1ab None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:15.728133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb1abb-e720-45fe-82ab-626d8b8daf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:15.729574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1abb-e720-45fe-82ab-626d8b8daf9e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.729574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1abb-e720-45fe-82ab-626d8b8daf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.729574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1abb-e720-45fe-82ab-626d8b8daf9e None admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.733486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb1abb-e720-45fe-82ab-626d8b8daf9e None admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:15.735235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb1abb-e720-45fe-82ab-626d8b8daf9e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:15.737386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 20/39] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:15 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:15.743455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.801212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3b52a-8fcc-42df-abef-a9cfc56226b1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.801536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3b52a-8fcc-42df-abef-a9cfc56226b1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.801926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3b52a-8fcc-42df-abef-a9cfc56226b1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.803426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 21/40] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:15.811437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dd42-e752-423b-868a-679083e53270 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.811437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dd42-e752-423b-868a-679083e53270 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.811437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15dd42-e752-423b-868a-679083e53270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.830632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ef15dd42-e752-423b-868a-679083e53270 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:15.832178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef15dd42-e752-423b-868a-679083e53270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:15.834240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:15.863894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605d58-d65a-4e9e-bc7a-3223e2778ac5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:15.903930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:15.904560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:15.904842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:15.905116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:15.906438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:15.908028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:15.909618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 20/41] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:15.913767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 22/42] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:15.918499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.937460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dd42-e752-423b-868a-679083e53270 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:15.968158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:16.031448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5c9c1-44e4-4507-8374-0552cd8f918b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:16.044760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15dd42-e752-423b-868a-679083e53270 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:16.067236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:16.067929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:16.068214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:16.068494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] PATH_INFO: `/v3/domains/default/users/35b61985750d49d482576c7757bd67fa/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:16.071025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=35b61985750d49d482576c7757bd67fa, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:16.072493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:16.085379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:16.086867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:16.087250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:16.087632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:16.088317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:16.089781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:16.089923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 21/43] 10.222.0.49 () {58 vars in 1361 bytes} [Wed Aug 31 00:05:15 2022] PUT /identity/v3/domains/default/users/35b61985750d49d482576c7757bd67fa/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:16.100631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:16.107094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 00:05:15 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:16.200462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:16.412794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28316-870d-47a2-94f1-1755b03e1b58 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:16.415750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:16.450568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee405f-f1ea-4cef-bf47-2481a3042688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:16.451224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee405f-f1ea-4cef-bf47-2481a3042688 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:16.451504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee405f-f1ea-4cef-bf47-2481a3042688 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:16.451778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee405f-f1ea-4cef-bf47-2481a3042688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:16.452901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee405f-f1ea-4cef-bf47-2481a3042688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:16.454401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee405f-f1ea-4cef-bf47-2481a3042688 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:16.456003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 22/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:16.462398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:16.560871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065374-1cf5-48be-b481-6fb24016b539 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:16.593234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319a1f6-2bba-4da2-95a1-27b9a6febe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:16.593858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319a1f6-2bba-4da2-95a1-27b9a6febe00 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:16.594150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319a1f6-2bba-4da2-95a1-27b9a6febe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:16.594424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319a1f6-2bba-4da2-95a1-27b9a6febe00 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:16.595077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319a1f6-2bba-4da2-95a1-27b9a6febe00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:16.596525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319a1f6-2bba-4da2-95a1-27b9a6febe00 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:16.623904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:05:16 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:17.980678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc1ea7-c40a-4cec-b2df-6002d812b1e9 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:17.981181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc1ea7-c40a-4cec-b2df-6002d812b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:17.981261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc1ea7-c40a-4cec-b2df-6002d812b1e9 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:17.982613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:17.987976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:17.988361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:17.988564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:18.006224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:18.007454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:18.052361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:18.074229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:18.342384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc1ea7-c40a-4cec-b2df-6002d812b1e9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:18.449133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc1ea7-c40a-4cec-b2df-6002d812b1e9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:18.482351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879381f-2d38-4e7e-a425-0166a654f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:18.482978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879381f-2d38-4e7e-a425-0166a654f62d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:18.483258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879381f-2d38-4e7e-a425-0166a654f62d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:18.483531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879381f-2d38-4e7e-a425-0166a654f62d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:18.493786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879381f-2d38-4e7e-a425-0166a654f62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f879381f-2d38-4e7e-a425-0166a654f62d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:18.498679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:18.499966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:18.501065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 24/49] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:18.505526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:18.513299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2d56-7734-4c7e-a4b3-0d36d3685145 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:18.513584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2d56-7734-4c7e-a4b3-0d36d3685145 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:18.513876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2d56-7734-4c7e-a4b3-0d36d3685145 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:18.515213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 25/50] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:18.520029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:18.520307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:18.520575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:18.537967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:18.539233 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:18.565381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:18.604616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3029c38-db4a-487d-80ed-8cf882cbb287 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:18.606994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:18.638160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:18.638769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:18.639050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:18.639324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:18.639981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:18.640283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:18.641674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:18.649429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:18.654813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:18.751337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0bef1-0a4e-46e2-9a43-cc8321cefef4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:18.784447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:18.785073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:18.785357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:18.785636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:18.786801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:18.788254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:18.789925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:18 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:18.795386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:18.838417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:18.873680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:18.906134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:18.983460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2ef8c-0004-4eb9-8ea8-34169347fa21 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:19.002837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d8a3-fd7d-46f2-8b2d-59e9f83d6faf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:19.017491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:19.018155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:19.018440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:19.018714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:19.019879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:19.021336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:19.022949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:19.029058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:19.036288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:19.036928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:19.037208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:19.037484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:19.038685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:19.040163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:19.041904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:19.048362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:19.129278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:19.133281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd466477-8909-402e-a678-5f651adc1313 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:19.144354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad0215-0eac-49e3-8c09-389b295c56fc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:19.154623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:19.166910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355a1b7-dc2e-4174-a49a-2fddca3efeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:19.167520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a1b7-dc2e-4174-a49a-2fddca3efeac None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:19.167801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a1b7-dc2e-4174-a49a-2fddca3efeac None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:19.168087 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a1b7-dc2e-4174-a49a-2fddca3efeac None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:19.168734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a1b7-dc2e-4174-a49a-2fddca3efeac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:19.170240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a1b7-dc2e-4174-a49a-2fddca3efeac None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:19.178444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:19.179046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:19.179337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:19.180203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:19.181182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.domain.id=default, user.id=35b61985750d49d482576c7757bd67fa) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:19.181495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:19.182947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a6383-ebbb-4f76-b0af-191871a052d0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:19.192590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Aug 31 00:05:19 2022] GET /identity/v3/role_assignments?user.id=35b61985750d49d482576c7757bd67fa&scope.domain.id=default&role.id=7c753c584d524b31b4742805d7365f68 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:19.198176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 29/57] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Aug 31 00:05:19 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:21.117927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d507-3781-48e0-8dde-990f3bb8a688 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:21.118419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d507-3781-48e0-8dde-990f3bb8a688 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:21.118419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d507-3781-48e0-8dde-990f3bb8a688 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:21.119777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:21.124870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:21.125258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:21.125429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:21.143780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:21.144970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:21.209627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:21.477722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d507-3781-48e0-8dde-990f3bb8a688 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:21.581258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d507-3781-48e0-8dde-990f3bb8a688 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:21.613999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0ba2f-7c33-4010-9073-a115387859a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:21.614611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0ba2f-7c33-4010-9073-a115387859a1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:21.614887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0ba2f-7c33-4010-9073-a115387859a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:21.615158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0ba2f-7c33-4010-9073-a115387859a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:21.616242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0ba2f-7c33-4010-9073-a115387859a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:21.617687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0ba2f-7c33-4010-9073-a115387859a1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:21.619272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:21.624694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:21.701071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:21.720872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363dd64-245c-4b12-9413-df2103d92fb7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:21.753383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a502b-e922-4c02-8f8f-80a946eaef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:21.753943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a502b-e922-4c02-8f8f-80a946eaef98 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:21.754224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a502b-e922-4c02-8f8f-80a946eaef98 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:21.754519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a502b-e922-4c02-8f8f-80a946eaef98 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:21.755161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a502b-e922-4c02-8f8f-80a946eaef98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:21.756599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a502b-e922-4c02-8f8f-80a946eaef98 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:21.782239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:21 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:24.829738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9692-e518-4d02-b470-ec7cd721d56a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:24.830259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9692-e518-4d02-b470-ec7cd721d56a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:24.830336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9692-e518-4d02-b470-ec7cd721d56a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:24.831659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:24.837662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c041c-a37f-4436-a3cb-cd0fc4d3bbe5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:24.838682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c041c-a37f-4436-a3cb-cd0fc4d3bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:24.839193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c041c-a37f-4436-a3cb-cd0fc4d3bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:24.862320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-630c041c-a37f-4436-a3cb-cd0fc4d3bbe5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:24.863835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-630c041c-a37f-4436-a3cb-cd0fc4d3bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:24.890674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfd89f-802f-47bb-9fdc-51291566aedd None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:24.891291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfd89f-802f-47bb-9fdc-51291566aedd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:24.891783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfd89f-802f-47bb-9fdc-51291566aedd None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:24.893317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:24.898346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81ee56-b57b-47e3-8d40-d8d275d8d617 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:24.898870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81ee56-b57b-47e3-8d40-d8d275d8d617 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:24.899385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81ee56-b57b-47e3-8d40-d8d275d8d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:24.925726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2a81ee56-b57b-47e3-8d40-d8d275d8d617 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:24.936005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2a81ee56-b57b-47e3-8d40-d8d275d8d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:24.985871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:24.989878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.029385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:25.058826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0390-5487-4f84-88e1-41d1992ba94b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.059438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0390-5487-4f84-88e1-41d1992ba94b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.059915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0390-5487-4f84-88e1-41d1992ba94b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.061466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 33/66] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:25.066860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156925b5-0b13-4141-b221-5c725c4fc715 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.067150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156925b5-0b13-4141-b221-5c725c4fc715 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.067428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156925b5-0b13-4141-b221-5c725c4fc715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.088117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-156925b5-0b13-4141-b221-5c725c4fc715 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:25.088912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-156925b5-0b13-4141-b221-5c725c4fc715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:25.173962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:25.195920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9de99-f271-4b47-a4ad-bd82f73a1bd2 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.196484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9de99-f271-4b47-a4ad-bd82f73a1bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.196957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9de99-f271-4b47-a4ad-bd82f73a1bd2 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.198785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 34/68] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:25.203743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.204033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.204310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.223595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:25.224795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:25.290878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9de99-f271-4b47-a4ad-bd82f73a1bd2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.297954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 35/69] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:25.406283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.427681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.452795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9de99-f271-4b47-a4ad-bd82f73a1bd2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.486172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.517268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.517934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.518221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.518497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.531934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:25.536835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:25.537704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:25.538514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 35/70] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:25.539219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.566267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf766761-7ddf-452e-ae3d-68354708f455 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.605244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.605905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.606191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.606466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.618940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:25.625558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:25.626580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:25.627344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:25.628528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.655457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9420-9ae9-4223-81c9-d7496d15a872 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.682473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.691460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.692084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.692361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.692633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.702414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:25.707175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:25.708138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:25.708910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 36/72] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:25.709540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.720931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.734851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ade135-fc3a-42f8-87b1-c028aa63f84a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.768383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.768993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.769276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.769549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.770258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:25.770562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:25.771960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0d90a-fe05-4fa6-a346-98c6b5610dc2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:25.780710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:25.781869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8497-e60f-4a21-af5e-980b3070090d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.782161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8497-e60f-4a21-af5e-980b3070090d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.782434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8497-e60f-4a21-af5e-980b3070090d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.783896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 38/74] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:25.784396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8497-e60f-4a21-af5e-980b3070090d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.810355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c360a-586c-4f7e-ba21-4f1a1c35e461 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.843774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.844398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.844675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.844954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.854891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:25.859681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:25.860707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:25.861572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.885777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8497-e60f-4a21-af5e-980b3070090d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.907423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.920152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.920757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.921039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.921314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.921999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:25.922305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:25.923727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:25.932603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:25.933590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:25.952229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:25.962745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cac48-f430-48f5-9868-094af82dbb5c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:25.996452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:25.997054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:25.997333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:25.997606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:25.998293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:25.998597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:25.999989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bbc0-e40e-4986-ba40-f7583300e4aa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.008022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 38/77] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.009147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.009432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.009931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.027428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:26.028619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:26.032685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fee-24b1-45e1-a588-ea847351d5bd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.067151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.067779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.068062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.068335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.083370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.084827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.086679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:25 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.087227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.098223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 39/79] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:26.099748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.152253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.168849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.195203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82a093-97f5-4adb-b848-b04e894dc4ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.220976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a7735-c55e-467a-9858-ecf73e028f0b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.229767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.230415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.230698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.231165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.231625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:26.231929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.233389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.242774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 41/80] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.243615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.260832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.261935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.262778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.263263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.264584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.266984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.269535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 40/81] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.270523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.360639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cc679-b7f6-4499-aa73-3e239f249103 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.373031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4d7ca-cc8e-44f9-aee3-ba139acff98a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.380339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.396512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.397148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.397435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.397710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.399451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.400885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.402507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 42/82] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.403261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.407086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.409601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.410247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.410529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.410808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.479300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.480809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.501738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9741cb-01f3-4be9-ba55-42de42e6527f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.536047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.536687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.536971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.537250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.538410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.539883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.541472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 43/83] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.542260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.578274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 41/84] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:26.579346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.587114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.612130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.643527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3109a-05c2-453a-81d0-a37a4af15e55 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.676470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0d7e-5cdc-4a01-8048-a958937dc363 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.676625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.677206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.677486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.677769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.709689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.710333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.710657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.711419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.712510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.714097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.715656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 42/85] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:26.718007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.746220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.747625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.796369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.814882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:26.821032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10ed9d-5246-4c04-ad13-f26ead1dc96a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.845704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 44/86] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:26.846568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:26.859747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.860389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.860672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.860950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:26.932022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:26.933526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:26.943913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d3df4-4c56-4111-b94d-28c119452087 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:26.977950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:26.978572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:26.978859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:26.979138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.004536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.019549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.030681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 43/87] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:27.031503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.050554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.052134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.129728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db75d-a4b4-41fe-98e6-0a5735054534 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.148945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 45/88] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:27.153197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.164407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.165037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.165318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.165591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.166752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.168211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.169838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 44/89] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.170617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.213999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.223818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.252572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264cfb-40b2-4ee4-8dca-d69faf53d194 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.270455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16ff8-9412-43ca-bcf8-f5445fabb36a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.285990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.286593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.286878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.287153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.287800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.289810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.302768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.303389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.303665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.303941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.305618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.307332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.309142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 45/90] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.310005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.317796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 46/91] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:27 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:27.318700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.427136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4eaeb-a1d1-446d-8f42-db8f3a146480 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.439176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.439600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bbb8e-6d93-49c8-b210-1d718d302026 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.470695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.471375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.471664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.471942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.472812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.473911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.478801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.478801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 46/92] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.478801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.484064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.484761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.486838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.486838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] PATH_INFO: `/v3/projects/0e435cade3314228a963c3a679c3907b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.489440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] RBAC: Authorizing `identity:get_project(project_id=0e435cade3314228a963c3a679c3907b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.489440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.493895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 47/93] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/projects/0e435cade3314228a963c3a679c3907b => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.493895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.605484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335804e-4137-4048-8952-a9a7d887d3c1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.620348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60770b3-c4c5-4f7e-b512-4c467c7cb15f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.651507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.652126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.652408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.652696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.653430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=c3a9cca237a24764b965735abc50c372) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:27.653729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.655537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.658159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.658825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.659098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.659371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.660093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=35b61985750d49d482576c7757bd67fa) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:27.660394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.666181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 47/94] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/role_assignments?user.id=c3a9cca237a24764b965735abc50c372&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=cd08b79af819428e9e3cdde76343f11e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.666388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.666482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.670932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 48/95] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/role_assignments?user.id=35b61985750d49d482576c7757bd67fa&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.671798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:27.738280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.819480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d055d-923d-41ed-8fc1-4f0c8637d07b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:27.886395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:27.907206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:27.908840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:27.909551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:27.910084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:27.910982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] RBAC: Adding query filter params (role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=c3a9cca237a24764b965735abc50c372) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:27.911559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:27.913375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aac2dd-36c9-45bb-97de-254c2eaa2df0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:27.933496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 48/96] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/role_assignments?user.id=c3a9cca237a24764b965735abc50c372&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=0c368ffea6f0432c889772bf6f846afe => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:27.949943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e4d1-841a-49fa-a626-dc38f790d976 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:28.004410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:28.005320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:28.005782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:28.006362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:28.007285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=0e435cade3314228a963c3a679c3907b, user.id=c3a9cca237a24764b965735abc50c372) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:28.007809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:28.009457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3d20-6760-486c-b5f9-6d94fa75610e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:28.022751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 49/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:27 2022] GET /identity/v3/role_assignments?user.id=c3a9cca237a24764b965735abc50c372&scope.project.id=0e435cade3314228a963c3a679c3907b&role.id=cd08b79af819428e9e3cdde76343f11e => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:30.011472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68d3b1-0ab2-42e9-9fac-154d70056d89 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.011970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68d3b1-0ab2-42e9-9fac-154d70056d89 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.012461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68d3b1-0ab2-42e9-9fac-154d70056d89 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.014118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 49/98] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:30.022654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aef76-7cc7-4122-8a17-cb71c3def8a8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.023134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aef76-7cc7-4122-8a17-cb71c3def8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.025539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aef76-7cc7-4122-8a17-cb71c3def8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.057503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-838aef76-7cc7-4122-8a17-cb71c3def8a8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:30.058755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-838aef76-7cc7-4122-8a17-cb71c3def8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:30.146833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:30.284654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97f2e-94b3-4775-8925-5fba6a94f64c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.284968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97f2e-94b3-4775-8925-5fba6a94f64c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.285218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97f2e-94b3-4775-8925-5fba6a94f64c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.286852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 50/100] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:30.292411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefe54b-12ac-4fe4-92c4-758207135a4e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.292705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefe54b-12ac-4fe4-92c4-758207135a4e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.292989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefe54b-12ac-4fe4-92c4-758207135a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.308061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fbac-bba4-4ee6-a8b9-d377c97291cf None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.308333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fbac-bba4-4ee6-a8b9-d377c97291cf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.308612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fbac-bba4-4ee6-a8b9-d377c97291cf None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.309967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 51/101] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:30.314744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6033b65-5006-4e43-9e53-dd79801d9dd3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.315024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6033b65-5006-4e43-9e53-dd79801d9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.315298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6033b65-5006-4e43-9e53-dd79801d9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.338715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7fefe54b-12ac-4fe4-92c4-758207135a4e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:30.339901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7fefe54b-12ac-4fe4-92c4-758207135a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:30.344273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e6033b65-5006-4e43-9e53-dd79801d9dd3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:30.346239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e6033b65-5006-4e43-9e53-dd79801d9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:30.438944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:30.462564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 51/102] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:30.486329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:30.676780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89512ed0-763a-459b-aaa2-2c71f381f1fe None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.677141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89512ed0-763a-459b-aaa2-2c71f381f1fe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.677331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89512ed0-763a-459b-aaa2-2c71f381f1fe None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.679000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 52/104] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:30.684050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.684554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.685030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.706707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:30.708171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:30.729693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89512ed0-763a-459b-aaa2-2c71f381f1fe None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:30.753832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:30.809461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 53/105] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:30.810665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:30.932123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89512ed0-763a-459b-aaa2-2c71f381f1fe None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:30.969218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:30.970175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:30.970598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:30.971029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:30.986182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:30.991639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357c65d-8fad-4764-8790-c02f8395df9b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:30.992654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:30.993720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:30.994696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 53/106] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:30.995335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.031874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67126d-1d2d-4d06-959a-cb6fa08d855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.032511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67126d-1d2d-4d06-959a-cb6fa08d855d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.032796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67126d-1d2d-4d06-959a-cb6fa08d855d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.033074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67126d-1d2d-4d06-959a-cb6fa08d855d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.044310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67126d-1d2d-4d06-959a-cb6fa08d855d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:31.046077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5f67126d-1d2d-4d06-959a-cb6fa08d855d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:31.049365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:31.050716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:31.051649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 54/107] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:31.052401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5d45-fabb-48f1-b1c6-b3d705e63cba None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.052559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5d45-fabb-48f1-b1c6-b3d705e63cba None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.052778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5d45-fabb-48f1-b1c6-b3d705e63cba None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.054217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 55/108] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:31.059006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5d45-fabb-48f1-b1c6-b3d705e63cba None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.084001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.115434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972b3d4-2367-41c4-9e72-77b9e84e4697 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.154474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.155109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.155388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.155912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.156892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.158417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.160031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 54/109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:31.161081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.168182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5d45-fabb-48f1-b1c6-b3d705e63cba None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.204336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.204946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.205227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.205837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.206200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:31.206504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.208019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8b58c-6895-4f2d-b858-374d663d0f2c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.216532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 56/110] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:31.222388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.222617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.222898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.241165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:31.242935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:31.268903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59373-2f13-4e5a-9bf6-af4c628e2afc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.283314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.304399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.305001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.305284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.305557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.306499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:31.306800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.308182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.312092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 57/111] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:31.312930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.322782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 55/112] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:31.326708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.334294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.429157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8f4d-c440-4790-bca1-36e784732024 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.448759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352b51-d340-4abb-bf7b-022371720865 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.464225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.464859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.465144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.465420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.477202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:31.482038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:31.482905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:31.484429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 58/113] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:31.486268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f90918-ea83-4a0b-a65d-9d503666dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.486879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90918-ea83-4a0b-a65d-9d503666dbd6 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.487171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90918-ea83-4a0b-a65d-9d503666dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.487449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90918-ea83-4a0b-a65d-9d503666dbd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.488236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f90918-ea83-4a0b-a65d-9d503666dbd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.488499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.489680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f90918-ea83-4a0b-a65d-9d503666dbd6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.523466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 56/114] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:05:31 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:31.523466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac7af6-e5a2-411a-91d4-41f81acf8823 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.523466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac7af6-e5a2-411a-91d4-41f81acf8823 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.523466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac7af6-e5a2-411a-91d4-41f81acf8823 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.523466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 57/115] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:31.523466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac7af6-e5a2-411a-91d4-41f81acf8823 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.562724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.600274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.627537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce565f-8f27-4056-804c-f3fad5a61c08 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.654241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac7af6-e5a2-411a-91d4-41f81acf8823 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.668691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.669336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.669642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.670646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] PATH_INFO: `/v3/users/21ffb899c8d944c696277b0679ba55b1` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.686660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] RBAC: Authorizing `identity:get_user(user_id=21ffb899c8d944c696277b0679ba55b1)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.688123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.689770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 59/116] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/users/21ffb899c8d944c696277b0679ba55b1 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:31.691674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.699372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8883c4f-71bd-4d3f-884d-070fa2e7e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.700032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883c4f-71bd-4d3f-884d-070fa2e7e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.700320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883c4f-71bd-4d3f-884d-070fa2e7e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.700594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883c4f-71bd-4d3f-884d-070fa2e7e4b3 None admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.701786 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8883c4f-71bd-4d3f-884d-070fa2e7e4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.703338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8883c4f-71bd-4d3f-884d-070fa2e7e4b3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.706504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 58/117] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:31.707880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.708350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.708350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.728665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:31.730759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:31.810203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 59/118] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:31.811358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.821995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2774-200c-4405-a4a1-ad1abdaf2761 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.841692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.886509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.887473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.888030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.888751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.890241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:31.890909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:31.892908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:31.898889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:31.909929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 60/119] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:31.911643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:31.927526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3a1a7-fc98-4524-9a2d-3e6377e13a94 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:31.970307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:31.971095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:31.971625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:31.971792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:31.983422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:31.988632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:31.989488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:31.990418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 60/120] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:31.992663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.044781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34175-6844-46ea-854c-bb1f292f3d68 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.082024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.083324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.083324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.083324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.097692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.116114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9ad56-8899-43dc-befd-198c167885eb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.150845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.151468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.151748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.152024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.152421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.153220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.154721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.157067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.159270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.161176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 61/121] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.162309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.264954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 61/122] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:32.265221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5990eea-109b-4656-a752-08c6154a1302 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.265710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.304986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.305740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.306369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.306652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.307791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.309269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.310876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 62/123] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.311636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.333867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.373947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.378076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f54f9-fe8d-4171-a734-3d0e7242df5f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.414320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.414936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.415222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.415502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.416175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:32.416332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af94fa0-81e3-4dbb-a3ff-6b8848caf404 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.416483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.417920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.427956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 62/124] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.428751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.456925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.457606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.457912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.458119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.468485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:32.473509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:32.474611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 63/125] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:32.475549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.539145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4b268-c50e-498e-89cc-3061ff03ba84 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.563595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.578448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.579159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.579459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.579729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/35b61985750d49d482576c7757bd67fa/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.581722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fb5124457bf44bfb8a2e4343e037ac7, user_id=35b61985750d49d482576c7757bd67fa, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.582991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3f6d-f0f7-46a2-908c-62259a57caf3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.583247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.596630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 63/126] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:32 2022] PUT /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/35b61985750d49d482576c7757bd67fa/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:32.597220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.623009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.658191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.659704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.660181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.660647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.662732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.665333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.668397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 64/127] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.673500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.736233 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212bc4-b6f4-46bc-8105-a862cd8b4d32 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.777638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.778323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.778610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.778891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.780729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.782696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.784545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 64/128] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.785114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.796647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c078844-1373-41da-98ab-63dd7e84af39 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.835986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.836629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.836915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.837615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.838837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.840790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.843248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 65/129] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.843869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.873562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.907796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:32.921038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39968d-dda2-46cc-baa4-f1c0cc92f559 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:32.958789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:32.959195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:32.959480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:32.959761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:32.960464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:32.960779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:32.962494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:32.979284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 65/130] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:32.979656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:32.985770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430848-2719-4833-87b0-ce445e9b16d3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.027491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.028329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.028744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.029149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.030033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] RBAC: Adding query filter params (role.id=be1578bb984d43c4bc09c0d2651cbd7a, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=21ffb899c8d944c696277b0679ba55b1) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:33.030501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.032082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.038165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 66/131] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:32 2022] GET /identity/v3/role_assignments?user.id=21ffb899c8d944c696277b0679ba55b1&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=be1578bb984d43c4bc09c0d2651cbd7a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:33.047154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:33.105871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0180314-2b0b-47bc-9152-0bdfc927773c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.169552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.170264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.170547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.171983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/c3a9cca237a24764b965735abc50c372/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.175772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fb5124457bf44bfb8a2e4343e037ac7, user_id=c3a9cca237a24764b965735abc50c372, role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.177547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.206851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 66/132] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:32 2022] PUT /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/c3a9cca237a24764b965735abc50c372/roles/0c368ffea6f0432c889772bf6f846afe => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:33.207576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:33.228297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:33.236634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:33.264846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847785c5-5ad2-49a5-ac32-668951660a9b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.335906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.336939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.337392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.337833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.339290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.340943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.342947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 67/133] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:33 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:33.348885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:33.396741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849cbb-40a4-4cf6-a262-4b6bd2ab9201 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.457880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.458627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.458921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.459204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.466653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.468283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.470397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 67/134] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:33 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:33.475706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:33.494860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587cfc0-6c1d-4924-a365-0db284112792 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.531094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab317e-1763-4eb8-a165-6cfb17b547b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.532116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab317e-1763-4eb8-a165-6cfb17b547b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.532586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab317e-1763-4eb8-a165-6cfb17b547b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.533050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab317e-1763-4eb8-a165-6cfb17b547b1 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/c3a9cca237a24764b965735abc50c372/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.535347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab317e-1763-4eb8-a165-6cfb17b547b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fb5124457bf44bfb8a2e4343e037ac7, user_id=c3a9cca237a24764b965735abc50c372, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.537011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab317e-1763-4eb8-a165-6cfb17b547b1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.556089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 68/135] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:33 2022] PUT /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/c3a9cca237a24764b965735abc50c372/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:33.560685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05fa0-57f9-4e52-a7c4-e3ed1f94830a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.561308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05fa0-57f9-4e52-a7c4-e3ed1f94830a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.561779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05fa0-57f9-4e52-a7c4-e3ed1f94830a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.564566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 69/136] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:33.571758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.572310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.572773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.608876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:33.612397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:33.614445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:33.616314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:33.660149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05b016-d06d-45e3-8edd-9f7836a9d474 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.728056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.728711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.728989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.729260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] PATH_INFO: `/v3/projects/0e435cade3314228a963c3a679c3907b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.730493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] RBAC: Authorizing `identity:get_project(project_id=0e435cade3314228a963c3a679c3907b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.731959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.736090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 68/137] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:33 2022] GET /identity/v3/projects/0e435cade3314228a963c3a679c3907b => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:33.742191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:33.747193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 70/138] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:33.896665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec02e-7643-48d4-8384-847df0b5f86c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:33.942526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:33.943192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.943470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.943744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] PATH_INFO: `/v3/projects/0e435cade3314228a963c3a679c3907b/users/c3a9cca237a24764b965735abc50c372/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.945700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] RBAC: Authorizing `identity:create_grant(project_id=0e435cade3314228a963c3a679c3907b, user_id=c3a9cca237a24764b965735abc50c372, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:33.947185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:33.967809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 69/139] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:33 2022] PUT /identity/v3/projects/0e435cade3314228a963c3a679c3907b/users/c3a9cca237a24764b965735abc50c372/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:34.188559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:34.300241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1327a39-d4b2-4bbf-a4d0-f128643757c2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:34.339695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29ecd-47d8-4ca1-8a67-56c8b10028c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:34.340336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29ecd-47d8-4ca1-8a67-56c8b10028c9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:34.340613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29ecd-47d8-4ca1-8a67-56c8b10028c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:34.340883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29ecd-47d8-4ca1-8a67-56c8b10028c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:34.342037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29ecd-47d8-4ca1-8a67-56c8b10028c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:34.343483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29ecd-47d8-4ca1-8a67-56c8b10028c9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:34.346126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 71/140] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:34.350781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:34.360921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:34.483230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b47ba6-3e53-4d74-a534-fad6f0de48ae None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:34.531365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462c63-3ccd-4d8c-befd-57ab6c22639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:34.531986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462c63-3ccd-4d8c-befd-57ab6c22639d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:34.532267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462c63-3ccd-4d8c-befd-57ab6c22639d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:34.532544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462c63-3ccd-4d8c-befd-57ab6c22639d None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:34.533202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462c63-3ccd-4d8c-befd-57ab6c22639d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:34.534690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462c63-3ccd-4d8c-befd-57ab6c22639d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:34.566407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 70/141] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:34 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:35.038415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095fa85-8263-4334-a001-56318a9551bc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:35.038831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095fa85-8263-4334-a001-56318a9551bc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:35.039023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095fa85-8263-4334-a001-56318a9551bc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:35.040515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 72/142] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:35.045951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a51a-9524-4281-8726-004bbbc784d2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:35.046245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a51a-9524-4281-8726-004bbbc784d2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:35.046589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146a51a-9524-4281-8726-004bbbc784d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:35.082872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e146a51a-9524-4281-8726-004bbbc784d2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:35.084090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e146a51a-9524-4281-8726-004bbbc784d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:35.157261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:35.176731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 71/143] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:35.627262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdb7c-59b6-45f0-8e53-655bfb6b8a74 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:35.627973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdb7c-59b6-45f0-8e53-655bfb6b8a74 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:35.627973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cdb7c-59b6-45f0-8e53-655bfb6b8a74 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:35.629125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 73/144] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:35.634616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:35.635151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:35.635151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:35.657836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:35.659051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:35.716303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdb7c-59b6-45f0-8e53-655bfb6b8a74 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:35.732769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:35.742939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 72/145] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:35.859911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cdb7c-59b6-45f0-8e53-655bfb6b8a74 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:35.924079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:35.924650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:35.924928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:35.925202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:35.940251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:35.945141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:35.946030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:35.946793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 74/146] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:35.954031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:36.096105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ead08-59c8-4857-9b41-182de9e101ba None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:36.126176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:36.142905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:36.144633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:36.145312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.145674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.145984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.146959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:36.147265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:36.149230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:36.165809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 73/147] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:36.173339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:36.329947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c0187-d603-4464-81b3-b172deafe1ba None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:36.342239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:36.397433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c04bc-99c0-4ce4-9749-b6d5861ba713 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:36.404038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8f979-1a3e-40c0-adba-6a4b1fac4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:36.404689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8f979-1a3e-40c0-adba-6a4b1fac4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.404964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8f979-1a3e-40c0-adba-6a4b1fac4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.405232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8f979-1a3e-40c0-adba-6a4b1fac4dc8 None admin] PATH_INFO: `/v3/users/35b61985750d49d482576c7757bd67fa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.406435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8f979-1a3e-40c0-adba-6a4b1fac4dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=35b61985750d49d482576c7757bd67fa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:36.407882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8f979-1a3e-40c0-adba-6a4b1fac4dc8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:36.409468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 74/148] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:36 2022] GET /identity/v3/users/35b61985750d49d482576c7757bd67fa => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:36.411501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaedcdc-1bb9-4b0f-a362-07a20f02c697 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.411783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaedcdc-1bb9-4b0f-a362-07a20f02c697 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.412049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaedcdc-1bb9-4b0f-a362-07a20f02c697 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.413308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 75/149] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:36.418364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaedcdc-1bb9-4b0f-a362-07a20f02c697 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:36.447558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c175df-e9cd-4f55-b52d-59ef65ec30be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:36.448313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c175df-e9cd-4f55-b52d-59ef65ec30be None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.448596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c175df-e9cd-4f55-b52d-59ef65ec30be None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.448867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c175df-e9cd-4f55-b52d-59ef65ec30be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.461692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c175df-e9cd-4f55-b52d-59ef65ec30be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-19c175df-e9cd-4f55-b52d-59ef65ec30be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:36.467366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:36.468217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:36.469010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 75/150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:36.469648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.470474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.470474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.499656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:36.501003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:36.558182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:36.625754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 76/151] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:36.626916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:36.661766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaedcdc-1bb9-4b0f-a362-07a20f02c697 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:36.691883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:36.735924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350d76d-1012-4c9f-8330-9bf1da67b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:36.736986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350d76d-1012-4c9f-8330-9bf1da67b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.737325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350d76d-1012-4c9f-8330-9bf1da67b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.737601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350d76d-1012-4c9f-8330-9bf1da67b9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.786249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919636-af13-4f1f-9707-b4a6555fadbb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:36.854481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:36.860246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.860530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.860808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.861496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:36.861802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:36.868443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3ed5-6559-415f-a1aa-3315326cdfac None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:36.877943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 77/152] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:36.879112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6021-decd-49b2-96bd-8641edab0a6f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:36.879388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6021-decd-49b2-96bd-8641edab0a6f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:36.879656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e6021-decd-49b2-96bd-8641edab0a6f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:36.880844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 78/153] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:36.883847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6021-decd-49b2-96bd-8641edab0a6f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:36.903028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350d76d-1012-4c9f-8330-9bf1da67b9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:36.907685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350d76d-1012-4c9f-8330-9bf1da67b9c5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:37.002196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:37.062648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e6021-decd-49b2-96bd-8641edab0a6f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:37.087082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:37.112802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:37.113442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.113720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.114021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] PATH_INFO: `/v3/users/21ffb899c8d944c696277b0679ba55b1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.116735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 76/154] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:37.117370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] RBAC: Authorizing `identity:get_user(user_id=21ffb899c8d944c696277b0679ba55b1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:37.118015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.118299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.118568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.118986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:37.120868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 79/155] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:36 2022] GET /identity/v3/users/21ffb899c8d944c696277b0679ba55b1 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:37.126071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.152340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:37.153491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:37.271953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065a6b-38a0-40c5-9c7d-318e33293e57 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:37.325443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 77/156] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:37.330040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.338526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:37.339476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.339953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.340520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.343715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:37.345421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:37.347457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 80/157] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:37 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:37.348404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.450805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:37.462824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:37.498802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda35b24-20ce-495b-b817-1f9947075c2c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:37.536270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35901577-c328-4990-a0b4-4f862a73e715 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:37.553164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:37.553805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.554671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.554938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.556313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:37.557895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:37.559823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 78/158] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:37 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:37.560441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.603358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:37.605104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.605388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.605654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.625800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:37.632104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:37.633597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:37.634416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:37.635038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 81/159] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:37.638385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.718072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87b3f-a768-41f0-b160-c8cd80d12190 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:37.772046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1f899-23fe-48c7-bbd9-a9ba6e0b8c44 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:37.774291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:37.775062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.775441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.775787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/21ffb899c8d944c696277b0679ba55b1/roles/be1578bb984d43c4bc09c0d2651cbd7a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.777810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] RBAC: Authorizing `identity:create_grant(project_id=0fb5124457bf44bfb8a2e4343e037ac7, user_id=21ffb899c8d944c696277b0679ba55b1, role_id=be1578bb984d43c4bc09c0d2651cbd7a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:37.779383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:37.789210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:37.804711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 79/160] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:37 2022] PUT /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/users/21ffb899c8d944c696277b0679ba55b1/roles/be1578bb984d43c4bc09c0d2651cbd7a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:37.805639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.814936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:37.815917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:37.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:37.818153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:37.819342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=35b61985750d49d482576c7757bd67fa) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:37.820388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:37.822208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:37.830648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 82/161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:37 2022] GET /identity/v3/role_assignments?user.id=35b61985750d49d482576c7757bd67fa&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:37.832695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:37.869670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:37.983137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10efa-d11d-40b1-aee1-5af5d0ac5afb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:38.039259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:38.039903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.040184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.040458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.041157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:38.041462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:38.042941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1802c29-78e4-473e-ad97-84338337b429 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:38.050944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c45e4b-c98b-4c76-b1ea-b1332243abb7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:38.051731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 80/162] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:38.052995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4b11-f88d-404c-b1da-bd2fed381551 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.053309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4b11-f88d-404c-b1da-bd2fed381551 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.053554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4b11-f88d-404c-b1da-bd2fed381551 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.063170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 81/163] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:38.064020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b4b11-f88d-404c-b1da-bd2fed381551 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:38.095766 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf412c-8ca9-4b22-910d-e17000c3bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:38.096790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf412c-8ca9-4b22-910d-e17000c3bc07 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.097304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf412c-8ca9-4b22-910d-e17000c3bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.097762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf412c-8ca9-4b22-910d-e17000c3bc07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.111797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf412c-8ca9-4b22-910d-e17000c3bc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-88cf412c-8ca9-4b22-910d-e17000c3bc07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:38.120475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:38.121461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:38.122292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:38.125927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 83/164] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:38.127908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.128444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.129265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.155598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:38.157513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:38.212972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:38.227320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:38.270484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 84/165] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:38.273885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:38.292558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b4b11-f88d-404c-b1da-bd2fed381551 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:38.368533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:38.369174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.369453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.369723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.371021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:38.374284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:38.376079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 82/166] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:38 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:38.382168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:38.439920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe414-0b11-4090-9686-91747468e455 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:38.483972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:38.485023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.485528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.486258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.487127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:38.488091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:38.489752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:38.503018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 85/167] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:38.510472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:38.564100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:38.595797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a687b8d-556e-4c97-ae53-c530949c10f6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:38.647948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:38.648936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.649409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.649906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.664387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:38.727246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:38.728498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76db3ea-2a88-408c-a134-3a9aad978970 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:38.729728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:38.821974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:38.822661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:38.822827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:38.823088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:38.824236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:38.825712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:38.827659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 86/168] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:38 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:38.832898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:38.840295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 83/169] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:38.846795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:38.933636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:38.992502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:38.999760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4219a-4766-4c33-b8f8-42d6d56d09cb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:39.030410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c286-e3c5-4775-bfa1-b382c9de03b8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:39.035502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:39.036459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.036968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.037435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.110819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:39.112682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:39.113664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e73e1-a164-478e-843d-1c4b2d4b5c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:39.114341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e73e1-a164-478e-843d-1c4b2d4b5c45 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.114620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e73e1-a164-478e-843d-1c4b2d4b5c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.114890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e73e1-a164-478e-843d-1c4b2d4b5c45 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.118551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e73e1-a164-478e-843d-1c4b2d4b5c45 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:39.120016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e73e1-a164-478e-843d-1c4b2d4b5c45 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:39.122094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 84/170] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:38 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:39.127108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8c3f-fbde-44ef-9acc-61041ea1d432 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.127392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8c3f-fbde-44ef-9acc-61041ea1d432 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.127666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8c3f-fbde-44ef-9acc-61041ea1d432 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.128996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 85/171] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:39.129776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8c3f-fbde-44ef-9acc-61041ea1d432 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:39.218882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:39.224185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 87/172] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:39.225667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:39.335297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8c3f-fbde-44ef-9acc-61041ea1d432 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:39.348449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:39.404891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883c070-8b39-4ce0-ae59-28d3d42e92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:39.405444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c070-8b39-4ce0-ae59-28d3d42e92ae None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.405719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c070-8b39-4ce0-ae59-28d3d42e92ae None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.406021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c070-8b39-4ce0-ae59-28d3d42e92ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.410233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a3e4-934c-4ec2-bdc6-c240993967cb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:39.429168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883c070-8b39-4ce0-ae59-28d3d42e92ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6883c070-8b39-4ce0-ae59-28d3d42e92ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:39.434937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:39.436115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:39.437090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 86/173] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:39.439873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad77046-bbac-490b-9daa-7b262ae756eb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.439873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad77046-bbac-490b-9daa-7b262ae756eb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.439873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad77046-bbac-490b-9daa-7b262ae756eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.457283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6ad77046-bbac-490b-9daa-7b262ae756eb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:39.458519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6ad77046-bbac-490b-9daa-7b262ae756eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:39.465348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:39.466062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.466407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.466747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.467947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] RBAC: Adding query filter params (role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=c3a9cca237a24764b965735abc50c372) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:39.468326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:39.470236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:39.478325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 88/174] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:39 2022] GET /identity/v3/role_assignments?user.id=c3a9cca237a24764b965735abc50c372&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=0c368ffea6f0432c889772bf6f846afe => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:39.482642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:39.587206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 87/175] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:39.590300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514cae8-aa83-4758-91a5-2e3da7ae3eed None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.591536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514cae8-aa83-4758-91a5-2e3da7ae3eed None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.591884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514cae8-aa83-4758-91a5-2e3da7ae3eed None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.594116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 88/176] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:39.595058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514cae8-aa83-4758-91a5-2e3da7ae3eed None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:39.620487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:39.674977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77b8a-5fc8-476c-85c5-e345be83ffe4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:39.720853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d851b3-9418-4f70-a9c6-be32e2e18ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:39.721935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d851b3-9418-4f70-a9c6-be32e2e18ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.722387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d851b3-9418-4f70-a9c6-be32e2e18ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.723109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d851b3-9418-4f70-a9c6-be32e2e18ba1 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.724912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d851b3-9418-4f70-a9c6-be32e2e18ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:39.727242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d851b3-9418-4f70-a9c6-be32e2e18ba1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:39.729513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 89/177] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:39 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:39.731396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1893a-8ea4-4439-ae54-352325bbe480 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.731828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1893a-8ea4-4439-ae54-352325bbe480 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.732261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1893a-8ea4-4439-ae54-352325bbe480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.753651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-14b1893a-8ea4-4439-ae54-352325bbe480 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:39.754793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-14b1893a-8ea4-4439-ae54-352325bbe480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:39.778073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514cae8-aa83-4758-91a5-2e3da7ae3eed None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:39.782165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:39.824818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:39.825480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.825915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.826211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.827023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:39.827315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:39.829379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:39.837667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 90/178] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:39.839841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ca64-7b45-4910-9b9f-658aaae3b298 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:39.840388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ca64-7b45-4910-9b9f-658aaae3b298 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:39.840750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 89/179] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:39.846049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:39.846577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ca64-7b45-4910-9b9f-658aaae3b298 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:39.848502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 91/180] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:39.849585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ca64-7b45-4910-9b9f-658aaae3b298 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:39.957136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:39.990165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837994c-9257-4e81-8d8c-005ecc9427e2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.019220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ca64-7b45-4910-9b9f-658aaae3b298 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.036078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.036915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.037396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.037810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.039337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=c3a9cca237a24764b965735abc50c372) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:40.039942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.041527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac231ada-61da-4c9c-b944-4c2cfbf6482f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.047809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 90/181] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:39 2022] GET /identity/v3/role_assignments?user.id=c3a9cca237a24764b965735abc50c372&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=cd08b79af819428e9e3cdde76343f11e => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:40.049269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.049823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.050288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.060488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.060941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.061224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.061494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] PATH_INFO: `/v3/users/c3a9cca237a24764b965735abc50c372` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.062832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a9cca237a24764b965735abc50c372)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.064346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.066296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 92/182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:39 2022] GET /identity/v3/users/c3a9cca237a24764b965735abc50c372 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:40.066887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.075519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:40.076990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:40.096800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.152000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 91/183] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:40.153165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.203705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e1262-7ce7-4d3b-8378-80dc0fdc86f7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.248909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.265456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9e10-27c0-4854-a230-afd696c5e285 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.274876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.275275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.275556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.275831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.291644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:40.300921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:40.302102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:40.303043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 93/184] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:40.311747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.313491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.314411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.314882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.315330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.350201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.398442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.400164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.449350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8c491-3a60-4602-883d-62d9c0d648ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.488390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.489143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.490470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.490914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.492547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:40.493016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.495048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.505966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 94/185] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:40.507247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.515246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 92/186] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:40.516190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.581062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.591519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.633685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ea04b-43d2-401c-9651-73966d761138 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.645305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1a2f-434c-4516-8cc7-a2582e89c5f5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.669109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.669739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.670048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.670326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.671439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.672881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.674483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 95/187] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:40.675248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.690553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.691292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.691561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.691829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] PATH_INFO: `/v3/users/01dd5a1c1db349fd9dd86889ff476920` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.706444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] RBAC: Authorizing `identity:get_user(user_id=01dd5a1c1db349fd9dd86889ff476920)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.707927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.709561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 93/188] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/users/01dd5a1c1db349fd9dd86889ff476920 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:40.714314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.783019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bdec6-3bb6-49f3-adf4-005090bfe8d9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.799883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.815851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aba06-9a6a-462a-8311-733d5aead6dd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.817290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.818589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.818589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.818589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] PATH_INFO: `/v3/projects/0e435cade3314228a963c3a679c3907b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.819637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] RBAC: Authorizing `identity:get_project(project_id=0e435cade3314228a963c3a679c3907b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.821086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.822748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 96/189] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/projects/0e435cade3314228a963c3a679c3907b => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:40.823489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.828759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:40.850120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.850751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.851643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.851927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.864727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:40.867315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:40.868194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:40.869018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 94/190] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:40.869698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:40.928418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec3c35-8afc-4a48-8b3d-eb69fb79717f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.962119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c338913-22d2-4dc2-8cbe-3ca4f6dec1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:40.962804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c338913-22d2-4dc2-8cbe-3ca4f6dec1f9 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.963090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c338913-22d2-4dc2-8cbe-3ca4f6dec1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.963366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c338913-22d2-4dc2-8cbe-3ca4f6dec1f9 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.964009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c338913-22d2-4dc2-8cbe-3ca4f6dec1f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:40.965467 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c338913-22d2-4dc2-8cbe-3ca4f6dec1f9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:40.971541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d9b6a-1548-4aec-b8dd-9c5c6001721d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:40.985035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 97/191] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:40 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:40.986301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd910-5ebb-4cc7-a0ee-4260d78986ff None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.986585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd910-5ebb-4cc7-a0ee-4260d78986ff None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.986860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd910-5ebb-4cc7-a0ee-4260d78986ff None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.988140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 98/192] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:40.988140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd910-5ebb-4cc7-a0ee-4260d78986ff None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.016442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7bded-c04d-4b24-9e48-a479dc043585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.017119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7bded-c04d-4b24-9e48-a479dc043585 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.017460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7bded-c04d-4b24-9e48-a479dc043585 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.017993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7bded-c04d-4b24-9e48-a479dc043585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.045649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.066094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.095091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7bded-c04d-4b24-9e48-a479dc043585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.096601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7bded-c04d-4b24-9e48-a479dc043585 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.118997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd910-5ebb-4cc7-a0ee-4260d78986ff None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.155220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.155832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.156112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.156862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.157543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=0e435cade3314228a963c3a679c3907b, user.id=c3a9cca237a24764b965735abc50c372) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:41.157907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.159578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.166115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 99/193] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/role_assignments?user.id=c3a9cca237a24764b965735abc50c372&scope.project.id=0e435cade3314228a963c3a679c3907b&role.id=cd08b79af819428e9e3cdde76343f11e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:41.166918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.233718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 95/194] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:41.235514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.235943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.236481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.259291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:41.260527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:41.296981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853eba-75cc-4d68-9fbf-6641ded27989 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.305788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.347488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.348123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.348678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.348959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.349638 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:41.349968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.352676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.358292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 96/195] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:41.360046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.367014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 100/196] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:41.369354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.370805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.484638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c28e49-4126-418b-ad5b-799d7b51aab2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.506178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53e34-f644-4379-af50-129e452c7632 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.525255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.526080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.526483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.526765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.528017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.529540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.531499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 97/197] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:41.537159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.553824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.554903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.555541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.556333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] PATH_INFO: `/v3/users/01dd5a1c1db349fd9dd86889ff476920` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.558563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] RBAC: Authorizing `identity:get_user(user_id=01dd5a1c1db349fd9dd86889ff476920)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.560868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.563192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 101/198] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/users/01dd5a1c1db349fd9dd86889ff476920 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:41.569449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.627136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.671576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.697341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9add-fdab-47c8-882d-1afd86ca3545 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.735685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.736483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.736861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.737236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.755664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94f500-811c-4c5d-9bc9-447b87e835e9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.794858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.795857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.796277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.796707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.797665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=01dd5a1c1db349fd9dd86889ff476920) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:41.798143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.799851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.807373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 98/199] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/role_assignments?user.id=01dd5a1c1db349fd9dd86889ff476920&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:41.808503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.809374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.811141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.848127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:41.973900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 102/200] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:41.977017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263660e-9e4c-4b1e-a0ca-59108eb0cc53 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.979647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:42.034461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:42.035100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:42.035429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:42.035699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:42.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:42.050869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:42.058615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:42.059698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:42.060742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 99/201] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:42.070808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:42.110821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277d36-6f58-4881-b5d0-eec4aff4e65c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:42.159043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:42.159687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:42.159966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:42.160239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:42.164943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:42.166432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:42.168287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 103/202] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:42.174479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:42.182173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:42.256547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c488de-4787-4124-95e7-f6ec5a08cf8e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:42.295439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:42.296204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:42.296489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:42.296765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:42.297439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:42.297799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:42.299284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:42.311410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 100/203] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:42.317087 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:42.383099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:42.435064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb104-80da-4469-9156-382989973e8c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:42.471847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244509d-d50b-498f-a56d-c75cbcb664ae None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:42.475728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:42.476891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:42.477176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:42.477454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] PATH_INFO: `/v3/users/21ffb899c8d944c696277b0679ba55b1` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:42.478691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] RBAC: Authorizing `identity:get_user(user_id=21ffb899c8d944c696277b0679ba55b1)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:42.480614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:42.482525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 101/204] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:42 2022] GET /identity/v3/users/21ffb899c8d944c696277b0679ba55b1 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:42.488452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:42.545350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:42.546029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:42.546307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:42.546574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:42.547302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] RBAC: Adding query filter params (role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=01dd5a1c1db349fd9dd86889ff476920) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:42.547599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:42.549033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:42.558134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 104/205] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:42 2022] GET /identity/v3/role_assignments?user.id=01dd5a1c1db349fd9dd86889ff476920&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=0c368ffea6f0432c889772bf6f846afe => generated 259 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:42.642641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830beeba-6674-4b0e-a25a-c87b25739604 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:42.675304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:42.688717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:42.689346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:42.689665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:42.689961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:42.795826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:42.797608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:42.948612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 102/206] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:42.954023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:43.038756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:43.083076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb6f-aa94-4204-8fd0-ef587e1d62a7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:43.134564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2892-fcd6-4a8b-a476-0c3eece59a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:43.135263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2892-fcd6-4a8b-a476-0c3eece59a19 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.135540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2892-fcd6-4a8b-a476-0c3eece59a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.135810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2892-fcd6-4a8b-a476-0c3eece59a19 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.137007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2892-fcd6-4a8b-a476-0c3eece59a19 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:43.138520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2892-fcd6-4a8b-a476-0c3eece59a19 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:43.140360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 105/207] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:42 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:43.145944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:43.171279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:43.248038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688851c-7cfe-49fd-b75c-77d77ad864ac None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:43.283028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:43.283635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.283904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.284172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.284896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] RBAC: Adding query filter params (role.id=be1578bb984d43c4bc09c0d2651cbd7a, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7, user.id=21ffb899c8d944c696277b0679ba55b1) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:43.285203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:43.286662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d081-2525-42d9-bc19-34b222e378ef None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:43.292952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 103/208] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:43 2022] GET /identity/v3/role_assignments?user.id=21ffb899c8d944c696277b0679ba55b1&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=be1578bb984d43c4bc09c0d2651cbd7a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:43.594173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ceee8-e70d-45c9-9714-b799edba8fe8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.594513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ceee8-e70d-45c9-9714-b799edba8fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.594693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ceee8-e70d-45c9-9714-b799edba8fe8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.595991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 106/209] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:43.601479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078910b-9f83-4347-8080-6223c7f940e1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.601768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078910b-9f83-4347-8080-6223c7f940e1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.602067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078910b-9f83-4347-8080-6223c7f940e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.622093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f078910b-9f83-4347-8080-6223c7f940e1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:43.623272 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f078910b-9f83-4347-8080-6223c7f940e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:43.697961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 104/210] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:43.703535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ba6b-4813-4b15-996d-1eb04dbfba16 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.703824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ba6b-4813-4b15-996d-1eb04dbfba16 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.704101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ba6b-4813-4b15-996d-1eb04dbfba16 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.705429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 107/211] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:43.710873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec566-0f19-42da-a98d-c02470ea6510 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.711415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec566-0f19-42da-a98d-c02470ea6510 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.711835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec566-0f19-42da-a98d-c02470ea6510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.733754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6d2ec566-0f19-42da-a98d-c02470ea6510 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:43.735193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6d2ec566-0f19-42da-a98d-c02470ea6510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:43.749183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:43.812841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 105/212] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:43.971942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971444-7593-45c5-bd18-dd31883c25a9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.972223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971444-7593-45c5-bd18-dd31883c25a9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.972501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971444-7593-45c5-bd18-dd31883c25a9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.973865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 108/213] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:43.979239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.979788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.980244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.985113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e971444-7593-45c5-bd18-dd31883c25a9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.003250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:44.004876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:44.097911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 106/214] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:44.108642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.115670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e971444-7593-45c5-bd18-dd31883c25a9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.161291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.161989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.162654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.162931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.166535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:44.179563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:44.187087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:44.188136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:44.191063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 109/215] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:44.201347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.214420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:44.241882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c624-0402-4fd1-a73a-36b3bec15683 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.277078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.277703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.278018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.278287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.279418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.280962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.287390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 107/216] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:44.288274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.303689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccd11c-3cdf-4731-a671-d69e9a3ba0ca None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.340712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.341326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.341602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.341900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.342571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:44.342873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.344983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.355572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 110/217] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:44.360958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.395718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f7fbe-309d-4815-a180-e78521638533 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.423943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:44.433235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.434154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.434154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.434406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.435042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.436473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.460386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 108/218] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:44 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:44.461190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.463925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:44.488227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27075e68-f110-434e-ab37-0c6ee00fe1d1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.529037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.529911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.530094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.530363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] PATH_INFO: `/v3/users/42cfeac5bdad4099b6d0ac06d3595acb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.549513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] RBAC: Authorizing `identity:get_user(user_id=42cfeac5bdad4099b6d0ac06d3595acb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.551486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.553282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 111/219] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/users/42cfeac5bdad4099b6d0ac06d3595acb => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:44.560126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.615223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a22c-b532-402a-b880-1cbe667b2989 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.658591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.659625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.659625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.659991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.672961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:44.679744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:44.680809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:44.681895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 109/220] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:44.684923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7068-92d8-4f1c-aaa5-ef1db7d30a95 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.687031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.703909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:44.736659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.737275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.737552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.737826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.772483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:44.825792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.827016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de19f37-ef81-48a0-bbc7-375aeee39fe4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.827334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.869176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.870697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.870697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.870697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.871204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:44.871572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.873058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.885063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 110/221] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:44.890860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.966040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 112/222] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:44.972346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.991042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:45.010748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1137d9e-7548-4492-bf96-d5ae7f92fd98 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.035651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:45.047800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99f21-8537-4ac4-aacc-047f44b508b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.048439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99f21-8537-4ac4-aacc-047f44b508b1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.048719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99f21-8537-4ac4-aacc-047f44b508b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.048997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99f21-8537-4ac4-aacc-047f44b508b1 None admin] PATH_INFO: `/v3/users/01dd5a1c1db349fd9dd86889ff476920` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.050165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d99f21-8537-4ac4-aacc-047f44b508b1 None admin] RBAC: Authorizing `identity:get_user(user_id=01dd5a1c1db349fd9dd86889ff476920)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:45.051639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d99f21-8537-4ac4-aacc-047f44b508b1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:45.053546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 111/223] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/users/01dd5a1c1db349fd9dd86889ff476920 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:45.055357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e439-0d5f-47cb-80d7-03c7cda6a69a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.055637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e439-0d5f-47cb-80d7-03c7cda6a69a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.056173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e439-0d5f-47cb-80d7-03c7cda6a69a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.057482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 112/224] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:45.062189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70e439-0d5f-47cb-80d7-03c7cda6a69a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:45.102846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09479fe6-4f2b-4d7d-a160-75c72a15fd5c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.148568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1ba89-e6a2-40d2-bd9f-b0bb9db3f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.150773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ba89-e6a2-40d2-bd9f-b0bb9db3f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.151275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ba89-e6a2-40d2-bd9f-b0bb9db3f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.152148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ba89-e6a2-40d2-bd9f-b0bb9db3f0ff None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.154001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1ba89-e6a2-40d2-bd9f-b0bb9db3f0ff None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:45.155662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1ba89-e6a2-40d2-bd9f-b0bb9db3f0ff None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:45.158531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 113/225] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:45.163722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.164247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.164350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.175915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70e439-0d5f-47cb-80d7-03c7cda6a69a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.183908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:45.185148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:45.221061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.222669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.223191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.224498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.226429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:45.228079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:45.230527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 113/226] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:45 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:45.231968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:45.261112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 114/227] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:45.270066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:45.294907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:45.310784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:45.360580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86f82-ece5-44fe-8950-795d26c2c3a1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.400332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.401322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.401807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.402310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.403504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=42cfeac5bdad4099b6d0ac06d3595acb) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:45.404264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:45.405924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:45.412632 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 114/228] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:45 2022] GET /identity/v3/role_assignments?user.id=42cfeac5bdad4099b6d0ac06d3595acb&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=cd08b79af819428e9e3cdde76343f11e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:45.461791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2ce5b-c463-4ec5-a967-5ab0cae88403 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.507454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.508143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.508424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.508713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/01dd5a1c1db349fd9dd86889ff476920/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.515828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] RBAC: Authorizing `identity:create_grant(project_id=ac488770b3384fcca78f291cdf2fc23c, user_id=01dd5a1c1db349fd9dd86889ff476920, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:45.518001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:45.544227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 115/229] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:45 2022] PUT /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/01dd5a1c1db349fd9dd86889ff476920/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:45.578675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:45.714111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd024605-53a1-4390-a329-416728fbe89c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.738309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:45.752940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.753577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.753869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.754180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.765410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:45.770721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:45.771623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:45.772407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 115/230] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:05:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:45.782971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:45.894877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:45.932369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793da01-689f-42f0-9a0b-0ea2e505eb4f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:45.979275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:45.979897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:45.980175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:45.980447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:45.981122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:45.981426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:45.982838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:45.996367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 116/231] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:46.001785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:46.128432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5051a7-a134-491c-9647-9247b83c8f7f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:46.164334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:46.165004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.165277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.165549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] PATH_INFO: `/v3/users/01dd5a1c1db349fd9dd86889ff476920` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.166711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] RBAC: Authorizing `identity:get_user(user_id=01dd5a1c1db349fd9dd86889ff476920)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:46.168178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:46.170059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 116/232] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:46 2022] GET /identity/v3/users/01dd5a1c1db349fd9dd86889ff476920 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:46.175722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:46.303558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291527b-c498-466d-9778-9990ce5d12a8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:46.336969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f2a5d-0144-4e1d-b74d-3e9fa4b161b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:46.337604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f2a5d-0144-4e1d-b74d-3e9fa4b161b6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.338067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f2a5d-0144-4e1d-b74d-3e9fa4b161b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.338340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f2a5d-0144-4e1d-b74d-3e9fa4b161b6 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.339457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f2a5d-0144-4e1d-b74d-3e9fa4b161b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:46.340894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f2a5d-0144-4e1d-b74d-3e9fa4b161b6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:46.342652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 117/233] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:46 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:46.348371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:46.425879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:46.479013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492c178-1d1d-4208-a1b8-e554e18e77d4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:46.513433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6afbc5-b0b0-4b68-b31b-e20d6c8e45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:46.514179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6afbc5-b0b0-4b68-b31b-e20d6c8e45a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.514459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6afbc5-b0b0-4b68-b31b-e20d6c8e45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.514727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6afbc5-b0b0-4b68-b31b-e20d6c8e45a3 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/01dd5a1c1db349fd9dd86889ff476920/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.516856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6afbc5-b0b0-4b68-b31b-e20d6c8e45a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac488770b3384fcca78f291cdf2fc23c, user_id=01dd5a1c1db349fd9dd86889ff476920, role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:46.518335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6afbc5-b0b0-4b68-b31b-e20d6c8e45a3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:46.536404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 117/234] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:46 2022] PUT /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/01dd5a1c1db349fd9dd86889ff476920/roles/0c368ffea6f0432c889772bf6f846afe => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:47.226126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180476bf-f67e-4d0c-82b9-882644b1b4e0 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.226605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180476bf-f67e-4d0c-82b9-882644b1b4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.226605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180476bf-f67e-4d0c-82b9-882644b1b4e0 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.227903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 118/235] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:47.233324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d37e60-b921-47be-8252-ea789588f25f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.233606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d37e60-b921-47be-8252-ea789588f25f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.233901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d37e60-b921-47be-8252-ea789588f25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.258873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-51d37e60-b921-47be-8252-ea789588f25f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:47.260053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-51d37e60-b921-47be-8252-ea789588f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:47.293735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5fa2-ee7c-4e3c-b3a0-935b08f1626f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.294142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5fa2-ee7c-4e3c-b3a0-935b08f1626f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.294361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5fa2-ee7c-4e3c-b3a0-935b08f1626f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.295817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 119/236] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:47.303664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f0b80-1314-4933-8c5e-938230eb64e9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.304468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f0b80-1314-4933-8c5e-938230eb64e9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.304745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f0b80-1314-4933-8c5e-938230eb64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.321136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.339845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 118/237] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:47.342844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fe7f0b80-1314-4933-8c5e-938230eb64e9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:47.344055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fe7f0b80-1314-4933-8c5e-938230eb64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:47.443707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 120/238] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:47.762512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d37e60-b921-47be-8252-ea789588f25f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.821666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.824975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc05f-9865-4795-bb6c-2e105ce9e36b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.825367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc05f-9865-4795-bb6c-2e105ce9e36b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.825746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc05f-9865-4795-bb6c-2e105ce9e36b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.827536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 121/239] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:47.845034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6385d0-7e77-4e9b-a4df-6f28801b9994 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.845457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6385d0-7e77-4e9b-a4df-6f28801b9994 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.845719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6385d0-7e77-4e9b-a4df-6f28801b9994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.882060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ef6385d0-7e77-4e9b-a4df-6f28801b9994 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:47.883452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef6385d0-7e77-4e9b-a4df-6f28801b9994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:47.888641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d37e60-b921-47be-8252-ea789588f25f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.928112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.928763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.929045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.929314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.941293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:47.946425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:47.947416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:47.948853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 119/240] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:47.950952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.965579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 122/241] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:47.966868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731823b-fdae-4550-a773-f82cfa68f94d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.967153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731823b-fdae-4550-a773-f82cfa68f94d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.967438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731823b-fdae-4550-a773-f82cfa68f94d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.972725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 123/242] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:47.972725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731823b-fdae-4550-a773-f82cfa68f94d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.074239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:48.111471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed7bd-0e2d-4fb6-8763-32a5741b8775 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.113167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:48.144783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731823b-fdae-4550-a773-f82cfa68f94d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.171129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f29f3c-87a5-4b58-a0f4-7805d24e6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.171789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f29f3c-87a5-4b58-a0f4-7805d24e6af8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.172062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f29f3c-87a5-4b58-a0f4-7805d24e6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.172574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f29f3c-87a5-4b58-a0f4-7805d24e6af8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.173419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f29f3c-87a5-4b58-a0f4-7805d24e6af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:48.174905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f29f3c-87a5-4b58-a0f4-7805d24e6af8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:48.177910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 120/243] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:48.177910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.177910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.187619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.193964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.195372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.195890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.196368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.197273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:48.197919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:48.199811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:48.207891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:48.209097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:48.215456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 124/244] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:48.220219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.286621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 121/245] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:48.287950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.334882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248922f-e7f6-436d-ba39-78b136dd32c7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.367570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:48.385262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.386671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.387259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.387934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.388739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:48.390219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:48.424104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 125/246] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:48 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:48.425823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.447371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:48.451974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acfd38-4e6e-42c8-89de-69fb27b69f59 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.501727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.502828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.503304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.503795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] PATH_INFO: `/v3/users/84ba51d4e5eb4d979680c08cf5eb9ac3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.531436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] RBAC: Authorizing `identity:get_user(user_id=84ba51d4e5eb4d979680c08cf5eb9ac3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:48.535384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:48.539772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 122/247] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:48 2022] GET /identity/v3/users/84ba51d4e5eb4d979680c08cf5eb9ac3 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:48.547738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.672487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a199f-2aae-4ee5-900d-ea4ed97acdf9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.717833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeae6de-1d8d-4b79-aa7b-71221bef0760 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.731270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.731270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.731270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.731270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.751341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:48.759424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:48.760350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:48.761153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 126/248] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:48.761801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.773511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0887c51-731f-4310-8b7e-91b9e509924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.774129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887c51-731f-4310-8b7e-91b9e509924a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.774129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887c51-731f-4310-8b7e-91b9e509924a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.774264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887c51-731f-4310-8b7e-91b9e509924a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.811648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:48.822026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:48.878296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0887c51-731f-4310-8b7e-91b9e509924a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:48.880370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0887c51-731f-4310-8b7e-91b9e509924a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:48.896722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e407b0-7f8b-4f1b-a4f7-32a341c16ce2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:48.941221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:48.942226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:48.943138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:48.943748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:48.958782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:48.966733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:48.967650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:48.968464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:48.971598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 127/249] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:48.972943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:48.998207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 123/250] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:48.999828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10120080-94fe-47ce-861a-d800d7050bbf None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.000241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10120080-94fe-47ce-861a-d800d7050bbf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.000672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10120080-94fe-47ce-861a-d800d7050bbf None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.002194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 124/251] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:49.003075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10120080-94fe-47ce-861a-d800d7050bbf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.084891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.090417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5dcd-b18b-4f80-a493-da8d4a2d0b3b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.092144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.129510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.130174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.130455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.130724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.131385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:49.131739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.133655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.142576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 128/252] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.143371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.144704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10120080-94fe-47ce-861a-d800d7050bbf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.190717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.192097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.192414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.193178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.194236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:49.195165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.197427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67b49a-5bd7-408f-9509-3fd212437de2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.210049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 125/253] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.212102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.212565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.212905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.236012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:49.237245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:49.258428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5014d40-d97f-47ae-be43-6000eec39a39 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.295307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.296214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.296647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.297073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.298396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.300030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.301876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 129/254] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.302883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.317397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 126/255] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:49.318397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.336666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.371115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.425366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a417632-376d-4956-b5e6-71ae1caa6e29 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.449661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7bd9e-3c45-41db-a713-65520f85d947 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.462998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99126473-7038-475f-98d8-966ac920b658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.463978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99126473-7038-475f-98d8-966ac920b658 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.464452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99126473-7038-475f-98d8-966ac920b658 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.464961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99126473-7038-475f-98d8-966ac920b658 None admin] PATH_INFO: `/v3/users/42cfeac5bdad4099b6d0ac06d3595acb` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.466313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99126473-7038-475f-98d8-966ac920b658 None admin] RBAC: Authorizing `identity:get_user(user_id=42cfeac5bdad4099b6d0ac06d3595acb)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.467966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99126473-7038-475f-98d8-966ac920b658 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.470138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 127/256] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/users/42cfeac5bdad4099b6d0ac06d3595acb => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.471159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99126473-7038-475f-98d8-966ac920b658 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.519162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.519753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.520034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.520311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] PATH_INFO: `/v3/users/01dd5a1c1db349fd9dd86889ff476920` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.526558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=01dd5a1c1db349fd9dd86889ff476920)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.528038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.533869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 130/257] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/users/01dd5a1c1db349fd9dd86889ff476920 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.533869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.583468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99126473-7038-475f-98d8-966ac920b658 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.602944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.621447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.622086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.622363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.622638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.623358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] RBAC: Adding query filter params (role.id=be1578bb984d43c4bc09c0d2651cbd7a, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=84ba51d4e5eb4d979680c08cf5eb9ac3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:49.623664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.625167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.630777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 128/258] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/role_assignments?user.id=84ba51d4e5eb4d979680c08cf5eb9ac3&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=be1578bb984d43c4bc09c0d2651cbd7a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.631469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.703935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.707147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d42960-5f20-465d-853a-80ec8189b6e2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.740400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc503e2-8b62-46ce-a0bf-dfed3b3d103b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:49.777737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.778520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.778773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.779137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.782664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:49.783419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:49.783701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:49.783971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:49.785164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.786645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:49.788410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 131/259] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:49.789294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:49.836005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:49.853436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:49.858051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.001831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aefe6f-382a-4c52-a656-5fd851907ec6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.002047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 129/260] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:50.002941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.037230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.038041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.038865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.039136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.055816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:50.060907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:50.061772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:05:50.062622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:50.064411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 132/261] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:50.070848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.131254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.186878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.216104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17777d0-12c0-4234-8355-35bcd953c6ef None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.223834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a55c-d342-49c2-b5ca-317eb71df657 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.252793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.253377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.253654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.253949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/42cfeac5bdad4099b6d0ac06d3595acb/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.257108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac488770b3384fcca78f291cdf2fc23c, user_id=42cfeac5bdad4099b6d0ac06d3595acb, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.258586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.279863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 130/262] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:50 2022] PUT /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/42cfeac5bdad4099b6d0ac06d3595acb/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:50.280696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.285683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.286492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.286778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.287055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.290649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.292305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.296310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 133/263] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:50.302665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.442353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691266-637c-4b36-8695-7acc539a2ec2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.482522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.483191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.483473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.483742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.484412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:50.484823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.486290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.495963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 131/264] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:50.501679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.505815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.571013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.582913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb22e-eaf3-459d-8fdf-3c42a3f98459 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.616170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7d7c-f4fb-480f-8a43-9b0fdd637320 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.646943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.648548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.648859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.649255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.650028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=01dd5a1c1db349fd9dd86889ff476920) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:50.650342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.651819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090dcbb-fe4d-4632-9972-c49d75133177 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.654189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.655010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.655469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.655880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] PATH_INFO: `/v3/users/01dd5a1c1db349fd9dd86889ff476920` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.657140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] RBAC: Authorizing `identity:get_user(user_id=01dd5a1c1db349fd9dd86889ff476920)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.658762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:50.660800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 132/265] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/users/01dd5a1c1db349fd9dd86889ff476920 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:50.666516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.667287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 134/266] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/role_assignments?user.id=01dd5a1c1db349fd9dd86889ff476920&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:50.766329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.806756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4a00-3ae7-4377-ba1f-db3d4d4784bc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:50.841259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04c6aa-c669-4b61-a0b4-0116172774f2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.841937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04c6aa-c669-4b61-a0b4-0116172774f2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.843106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04c6aa-c669-4b61-a0b4-0116172774f2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.844909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 135/267] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:50.851254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.851540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.851821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.863225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:50.864199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.864678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.868122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.894983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:50.896324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:50.953289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:50.955339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.089006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 136/268] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:51.094205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.166218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 133/269] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:51.174029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.309340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.320078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0eb4e-8f88-472f-bfef-2b2a1ade9bcd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.358064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3215-fb31-4e4e-b144-f9a78b57cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.358618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3215-fb31-4e4e-b144-f9a78b57cbbd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.358895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3215-fb31-4e4e-b144-f9a78b57cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.359221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3215-fb31-4e4e-b144-f9a78b57cbbd None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.360342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3215-fb31-4e4e-b144-f9a78b57cbbd None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.361801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3215-fb31-4e4e-b144-f9a78b57cbbd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.363630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 137/270] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:51.369498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.451484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adedc9-5d23-40cc-9a9d-276c2aa08c72 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.452130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adedc9-5d23-40cc-9a9d-276c2aa08c72 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.452597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adedc9-5d23-40cc-9a9d-276c2aa08c72 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.454229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 138/271] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:51.459254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.459773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.460922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.481249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:51.483386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:51.510275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd660f0-9c1c-46fe-aefd-daa74e2b89be None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.548439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.549041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.549322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.549597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.550352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] RBAC: Adding query filter params (role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=01dd5a1c1db349fd9dd86889ff476920) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:51.550660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.552218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.562019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 134/272] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/role_assignments?user.id=01dd5a1c1db349fd9dd86889ff476920&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=0c368ffea6f0432c889772bf6f846afe => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:51.562019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.578083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 139/273] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:51.602122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.711211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cca1ad-0649-4b23-907a-e97e30ec1e1c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.772207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.773404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.773684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.774037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.782181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.783784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.785493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 135/274] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:51.791608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.909551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.916791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.927335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ebb3-1b47-4c6d-9a30-7a1e5667f6eb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.973373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.973922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.974203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.974483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.977064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.978646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.009998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 140/275] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:51 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:52.067692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce37be3-281c-4096-a6c5-6528b6665062 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.071192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.109166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d7e1-cbd9-45e4-8ef4-c51034089988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.109822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d7e1-cbd9-45e4-8ef4-c51034089988 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.110129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d7e1-cbd9-45e4-8ef4-c51034089988 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.110404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d7e1-cbd9-45e4-8ef4-c51034089988 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.123844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d7e1-cbd9-45e4-8ef4-c51034089988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-33f9d7e1-cbd9-45e4-8ef4-c51034089988 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:52.129712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:52.130676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:52.131557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 136/276] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:52.137566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.241393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373220b3-9d48-4486-8aed-7e48e1043015 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.242020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373220b3-9d48-4486-8aed-7e48e1043015 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.242518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373220b3-9d48-4486-8aed-7e48e1043015 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.244122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 137/277] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:52.250385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.250668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.250942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.255973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9493a-f7e1-4795-97e2-b8e4d9d3df11 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.273677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:52.276006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:52.299205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.299818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.300100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.300375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.301041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:52.303222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.303222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.315683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 141/278] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:52.321839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.333407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.373440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 138/279] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:52.443104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145db7d-7530-48b5-aa45-728e6b1d2040 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.479295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.479931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.480272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.480545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] PATH_INFO: `/v3/users/3f32687b1be44b2d9c87255b22a57077` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.495545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] RBAC: Authorizing `identity:get_user(user_id=3f32687b1be44b2d9c87255b22a57077)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.496954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.499023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 142/280] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/users/3f32687b1be44b2d9c87255b22a57077 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:52.504617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.604112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.612515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d28da8-a116-4029-88ee-fb067073d567 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.665172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.665775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.666073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.667271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.668015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, user.id=3f32687b1be44b2d9c87255b22a57077, scope.system=all) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:52.668321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.669818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2546d-1b1d-4aa2-86e2-293b8b1f23ad None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.670343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.675247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 139/281] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/role_assignments?user.id=3f32687b1be44b2d9c87255b22a57077&scope.system=all&role.id=cd08b79af819428e9e3cdde76343f11e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:52.746156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495cab1-600b-4928-ada2-c3e2c7a3339f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.746337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495cab1-600b-4928-ada2-c3e2c7a3339f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.746608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495cab1-600b-4928-ada2-c3e2c7a3339f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.748180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 140/282] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:52.755611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.755903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.756148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.763048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.798532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:52.801015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:52.840219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73966880-f8ff-4af3-818a-253337f0d29a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.909078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.910088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.910571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.911040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.925556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 141/283] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:52.938631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:52.943807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:52.945248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:52.946071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:52.948328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 143/284] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:52.954191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.080390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:53.093221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804afd43-b28e-41e4-a2fa-75156b9b27d0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.129131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.129794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.130106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.130379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.131107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:53.131414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.132859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.141347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 142/285] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:53.146909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.246119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.280150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba3d67-8c0f-4638-9960-ee170ad077a6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.305741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:53.330094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.330781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.331001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.331271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] PATH_INFO: `/v3/users/84ba51d4e5eb4d979680c08cf5eb9ac3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.333255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] RBAC: Authorizing `identity:get_user(user_id=84ba51d4e5eb4d979680c08cf5eb9ac3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.334737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.338492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 144/286] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/users/84ba51d4e5eb4d979680c08cf5eb9ac3 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:53.343624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.418258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756f2ff-5c02-41e6-80e9-826c27b01cc2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.483069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.483694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.483969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.484236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.502338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:53.509010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:53.509936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:53.510758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:53.511913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 143/287] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:53.519990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc12e8-40c2-4a85-b2b5-cf6a3a94a081 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.521913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.544093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:53.580152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.580388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.580608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.580878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.583897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.585385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.587052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 145/288] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:53.593504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.695704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:53.706299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81505f39-87cf-4fab-8345-adbb06cc73db None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.765363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1bc8-5800-4f96-aab0-787e17337916 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:53.767878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.768492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.768767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.769035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.769696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:53.770021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.771418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.786723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 144/289] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:53.792204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:53.844232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.844828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.845106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.845378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/84ba51d4e5eb4d979680c08cf5eb9ac3/roles/be1578bb984d43c4bc09c0d2651cbd7a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.848124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] RBAC: Authorizing `identity:create_grant(project_id=ac488770b3384fcca78f291cdf2fc23c, user_id=84ba51d4e5eb4d979680c08cf5eb9ac3, role_id=be1578bb984d43c4bc09c0d2651cbd7a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.849564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.884298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 146/290] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:05:53 2022] PUT /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c/users/84ba51d4e5eb4d979680c08cf5eb9ac3/roles/be1578bb984d43c4bc09c0d2651cbd7a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:05:53.931431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:53.976105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502b0dc-cc3a-4e39-b457-8a13e3d1e199 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.021185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.021823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.022119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.022933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] PATH_INFO: `/v3/users/42cfeac5bdad4099b6d0ac06d3595acb` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.025755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] RBAC: Authorizing `identity:get_user(user_id=42cfeac5bdad4099b6d0ac06d3595acb)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.027229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.029038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 145/291] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:53 2022] GET /identity/v3/users/42cfeac5bdad4099b6d0ac06d3595acb => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:54.034601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.166411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45da3ec-01d4-4441-ba01-e9f53baea8ee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.190099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.209617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.210356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.210830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.211357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.290703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.292996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.418033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 147/292] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:54.423560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.569750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d5d33-613f-4140-b67d-85b9aaf9ff14 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.615439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0e949-c20b-4f87-a3ea-15f1ef3ba17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.616960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e949-c20b-4f87-a3ea-15f1ef3ba17f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.617438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e949-c20b-4f87-a3ea-15f1ef3ba17f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.617978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0e949-c20b-4f87-a3ea-15f1ef3ba17f None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.619394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0e949-c20b-4f87-a3ea-15f1ef3ba17f None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.621063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0e949-c20b-4f87-a3ea-15f1ef3ba17f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.622954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 146/293] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:54.629000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:54.672519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.766820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cd3c-6443-4f43-ad32-034b516bdd60 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:54.783655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2fbf9-fce9-4f3c-a986-11fd021e9b42 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.784246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2fbf9-fce9-4f3c-a986-11fd021e9b42 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.784717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2fbf9-fce9-4f3c-a986-11fd021e9b42 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.786324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 147/294] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:54.798049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e0efc-2a5c-4b1a-a09a-007981ea8b5a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.798597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e0efc-2a5c-4b1a-a09a-007981ea8b5a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.799055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e0efc-2a5c-4b1a-a09a-007981ea8b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.809228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:54.809838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.810146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.810418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.811142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=42cfeac5bdad4099b6d0ac06d3595acb) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:54.811448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:54.812900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2e1e-0201-403f-aad8-681eea7bd402 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:54.819205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 148/295] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:54 2022] GET /identity/v3/role_assignments?user.id=42cfeac5bdad4099b6d0ac06d3595acb&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=cd08b79af819428e9e3cdde76343f11e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:54.824561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b152c-870b-421a-9fcf-ce2eae272884 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.824848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b152c-870b-421a-9fcf-ce2eae272884 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.825124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b152c-870b-421a-9fcf-ce2eae272884 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.826436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 149/296] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:54.832125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e87e0efc-2a5c-4b1a-a09a-007981ea8b5a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:54.832305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e87e0efc-2a5c-4b1a-a09a-007981ea8b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:54.833666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.833969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.834245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.838733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:54.873879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:54.873879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:54.969336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 148/297] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:54.970574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a648a-ea03-4a09-b1e5-4ad4934ce7ab None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.970926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a648a-ea03-4a09-b1e5-4ad4934ce7ab None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.971204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a648a-ea03-4a09-b1e5-4ad4934ce7ab None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.977351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 149/298] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:54.978691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:54.978977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:54.979256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:54.992367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 150/299] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:55.007956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:55.009437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:55.081026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 150/300] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:55.249274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.264886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.290869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.365405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75b127-3d34-432d-95a9-1d8db738ca41 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.400755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.404547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.405293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.405569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.405836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.416810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:55.421627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:55.422749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:55.423570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 151/301] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:55.424214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.445837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ed38-98af-43de-bdca-3cec3eb8b019 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.488191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.489513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.490350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.491140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.504918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:55.505444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:55.512181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:55.513291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:55.514340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:55.517545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 151/302] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:55.518789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.533798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659334d-5af9-4023-aaa3-c6d947358945 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.568855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.569477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.569769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.570050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.571258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.572718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.574455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 152/303] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:55.579454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.626295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd8728-8e68-4e90-aa70-467d56c14057 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.655091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.665475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.666116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.666389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.667052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.667321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:55.667623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.669011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.677908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 152/304] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:55.683422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.694183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fb3b-fe47-4537-acb9-477c04fd9297 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.729709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.730697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.730977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.731558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.732224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:55.732527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.733926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.742662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 153/305] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:55.747396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.752095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.790697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677971a-546c-4635-9ceb-55e201a27fae None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.825686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.826320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.826602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.826873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] PATH_INFO: `/v3/groups` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.827494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.828933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.844782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 153/306] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Aug 31 00:05:55 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:55.845586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.866191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a97d5-2c53-490c-a103-0636c68c9253 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.905362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.912789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.914824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.915352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.915825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] PATH_INFO: `/v3/users/fca598d697cf4302bf684e9117d7aec2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.939726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] RBAC: Authorizing `identity:get_user(user_id=fca598d697cf4302bf684e9117d7aec2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.941726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.944884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 154/307] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/users/fca598d697cf4302bf684e9117d7aec2 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:55.955155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.964289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12bb6a-1b8d-46ad-b1b1-fdf9c329623d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.001279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.001930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.002237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.002517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] PATH_INFO: `/v3/users/3f32687b1be44b2d9c87255b22a57077` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.003732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] RBAC: Authorizing `identity:get_user(user_id=3f32687b1be44b2d9c87255b22a57077)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.005188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.006873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 154/308] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/users/3f32687b1be44b2d9c87255b22a57077 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:56.012366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:56.027173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:56.077054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78958dba-9a1f-4977-a3fa-93e697855e4e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.121476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.122729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.123133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.123616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.124566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] RBAC: Adding query filter params (role.id=be1578bb984d43c4bc09c0d2651cbd7a, user.id=fca598d697cf4302bf684e9117d7aec2, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:56.125144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.127460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9b981-d59f-4983-ad97-1f42cfd7614e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.134847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 155/309] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/role_assignments?user.id=fca598d697cf4302bf684e9117d7aec2&scope.system=all&role.id=be1578bb984d43c4bc09c0d2651cbd7a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:56.135207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9aa22-7272-4b72-989f-5c609af56d3a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.161962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:56.184364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb1121-7e1b-4459-af22-5f4337edf1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.185046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1121-7e1b-4459-af22-5f4337edf1f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.185319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1121-7e1b-4459-af22-5f4337edf1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.185591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1121-7e1b-4459-af22-5f4337edf1f9 None admin] PATH_INFO: `/v3/system/users/3f32687b1be44b2d9c87255b22a57077/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.187163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb1121-7e1b-4459-af22-5f4337edf1f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f32687b1be44b2d9c87255b22a57077, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.188604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb1121-7e1b-4459-af22-5f4337edf1f9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.199331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 155/310] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Aug 31 00:05:56 2022] PUT /identity/v3/system/users/3f32687b1be44b2d9c87255b22a57077/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:05:56.329937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8911af-6b9d-4e4d-92f9-0c65f60faf96 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.330245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8911af-6b9d-4e4d-92f9-0c65f60faf96 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.330411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8911af-6b9d-4e4d-92f9-0c65f60faf96 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.332324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 156/311] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:56.338672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.339291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.339768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.360163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:56.361388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:56.434067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 156/312] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:56.703615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8911af-6b9d-4e4d-92f9-0c65f60faf96 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:56.809866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8911af-6b9d-4e4d-92f9-0c65f60faf96 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.836538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:56.845657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.850591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.851021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.851424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.862023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:56.873253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:56.874761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:56.875576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 157/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:56.878100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:56.987189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969159f-d4c1-4c9f-8216-0223896641c0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:57.001071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:57.024579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:57.025171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.025455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.026109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.026780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:57.027576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:57.029038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:57.037958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 157/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:57.044185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:57.151133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6f60-7649-4ef0-95e1-aa13c9b734fc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:57.186733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:57.187635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.188092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.188538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] PATH_INFO: `/v3/users/84ba51d4e5eb4d979680c08cf5eb9ac3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.189833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] RBAC: Authorizing `identity:get_user(user_id=84ba51d4e5eb4d979680c08cf5eb9ac3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:57.191488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:57.193241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 158/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:57 2022] GET /identity/v3/users/84ba51d4e5eb4d979680c08cf5eb9ac3 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:57.199763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:57.306219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f05df-4fad-4668-8e00-c465a46aa953 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:57.341716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:57.342714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.343172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.343622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.402638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:57.418318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:57.419828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:57.521595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 158/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:05:57.527713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:57.585303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:57.631182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5aa17-8abc-4125-8636-fceb5a213178 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:57.667026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31769296-c8e0-4507-bffc-0828f1111b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:57.667660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769296-c8e0-4507-bffc-0828f1111b0f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.667938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769296-c8e0-4507-bffc-0828f1111b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.668208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31769296-c8e0-4507-bffc-0828f1111b0f None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.669339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31769296-c8e0-4507-bffc-0828f1111b0f None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:57.670824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31769296-c8e0-4507-bffc-0828f1111b0f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:57.672810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 159/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:05:57 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:57.679210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:57.758017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:57.784088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b6701-aaa3-4630-a81b-887540638afb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:57.819819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:57.820432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.820710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.820992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.821710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] RBAC: Adding query filter params (role.id=be1578bb984d43c4bc09c0d2651cbd7a, scope.project.id=ac488770b3384fcca78f291cdf2fc23c, user.id=84ba51d4e5eb4d979680c08cf5eb9ac3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:57.822048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:57.823539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e94ac-5a9c-4f81-b349-9c24cbe13701 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:57.829528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 159/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:05:57 2022] GET /identity/v3/role_assignments?user.id=84ba51d4e5eb4d979680c08cf5eb9ac3&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=be1578bb984d43c4bc09c0d2651cbd7a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:57.891194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab18f9-380f-4137-a0a9-d258ecfab2c9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.891712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab18f9-380f-4137-a0a9-d258ecfab2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.891712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab18f9-380f-4137-a0a9-d258ecfab2c9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.893101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 160/319] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:57.898835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35fa8-19ba-45dd-9a14-b9964cf9575a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:57.899132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35fa8-19ba-45dd-9a14-b9964cf9575a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:57.899453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b35fa8-19ba-45dd-9a14-b9964cf9575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:57.919105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-30b35fa8-19ba-45dd-9a14-b9964cf9575a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:57.920301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-30b35fa8-19ba-45dd-9a14-b9964cf9575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:57.997981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 160/320] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:58.062083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5146-a4ce-4c3e-b6b3-076f74626723 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.062410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5146-a4ce-4c3e-b6b3-076f74626723 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.062623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5146-a4ce-4c3e-b6b3-076f74626723 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.063968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 161/321] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:58.069123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468899e-f0c7-4c7f-99e7-a779fe635c1c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.069547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468899e-f0c7-4c7f-99e7-a779fe635c1c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.069664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468899e-f0c7-4c7f-99e7-a779fe635c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.087682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8468899e-f0c7-4c7f-99e7-a779fe635c1c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:58.088897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8468899e-f0c7-4c7f-99e7-a779fe635c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:58.152546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.158509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 161/322] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:58.268268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5146-a4ce-4c3e-b6b3-076f74626723 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.287402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f252d-34b9-4a0f-848b-9a62130e3d7e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.287684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f252d-34b9-4a0f-848b-9a62130e3d7e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.288526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f252d-34b9-4a0f-848b-9a62130e3d7e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.290081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 162/323] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:58.294809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.295091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.295361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.313277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:58.314466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:58.383328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5146-a4ce-4c3e-b6b3-076f74626723 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.388717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 163/324] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:58.410263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.422867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.423492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.423767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.424041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.425180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:58.426534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.426665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:58.428459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 162/325] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:58.433698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.529664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6660eb-0760-4b86-89fd-b604e85d8456 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.540864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d601279-38f2-4dde-990a-740442da0256 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.560879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.570168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.570791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.571073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.571347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.575875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.576669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.577294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.577790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] PATH_INFO: `/v3/groups` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.578648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:58.580340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:58.581699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:58.587211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:58.588150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:05:58.590041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 164/326] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:58.594428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.605868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 163/327] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Aug 31 00:05:58 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:58.660226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.707468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872334bd-b79d-4364-8b19-9341486e7a2e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.714802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.746622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.748328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.748328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.748328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.748616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:58.748707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:58.750095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:58.761578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 165/328] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:58.766818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.778066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383815a-6389-42cc-88c5-ba871daa0692 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.814991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.815626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.815902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.816169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.829216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:58.834071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:58.834617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:58.835549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:05:58.837324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 164/329] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:58.841677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.904422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c23365-2651-4e63-a9cd-913abd637188 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.952678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.954436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.954436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.954436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] PATH_INFO: `/v3/users/fca598d697cf4302bf684e9117d7aec2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.955827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] RBAC: Authorizing `identity:get_user(user_id=fca598d697cf4302bf684e9117d7aec2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:58.956519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:58.958397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 166/330] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/users/fca598d697cf4302bf684e9117d7aec2 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:58.965776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a695-e9b1-4fa0-9095-74aca4631544 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.967439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.981214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:59.013018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.014020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.014504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.014977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.015877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:59.016188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.017592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.031330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 165/331] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:59.036561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.101580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73650228-d713-44d7-9a5d-ad172f14cca1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.122540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:59.147553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.148580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.148867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.149146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] PATH_INFO: `/v3/system/users/fca598d697cf4302bf684e9117d7aec2/roles/be1578bb984d43c4bc09c0d2651cbd7a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.150943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fca598d697cf4302bf684e9117d7aec2, role_id=be1578bb984d43c4bc09c0d2651cbd7a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.152651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.160966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 167/332] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Aug 31 00:05:58 2022] PUT /identity/v3/system/users/fca598d697cf4302bf684e9117d7aec2/roles/be1578bb984d43c4bc09c0d2651cbd7a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:05:59.177311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711a2c3-6b9e-46f1-97d5-4e9661935046 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.220342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd7cd-59b3-433d-9322-ab1a88058981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.221221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd7cd-59b3-433d-9322-ab1a88058981 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.221654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd7cd-59b3-433d-9322-ab1a88058981 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.222099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd7cd-59b3-433d-9322-ab1a88058981 None admin] PATH_INFO: `/v3/users/3f32687b1be44b2d9c87255b22a57077` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.223580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcd7cd-59b3-433d-9322-ab1a88058981 None admin] RBAC: Authorizing `identity:get_user(user_id=3f32687b1be44b2d9c87255b22a57077)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.225482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcd7cd-59b3-433d-9322-ab1a88058981 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.227780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 166/333] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/users/3f32687b1be44b2d9c87255b22a57077 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:59.235211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:59.384677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bba0b-0582-4800-a70a-093574ed053c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:59.424492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:59.425099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:59.425374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:59.425642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:59.426403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] RBAC: Adding query filter params (role.id=cd08b79af819428e9e3cdde76343f11e, user.id=3f32687b1be44b2d9c87255b22a57077, scope.system=all) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:59.426708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:59.428153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed5a3a-641c-4200-94b7-91d79158e481 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:59.441023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 168/334] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 00:05:59 2022] GET /identity/v3/role_assignments?user.id=3f32687b1be44b2d9c87255b22a57077&scope.system=all&role.id=cd08b79af819428e9e3cdde76343f11e => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:01.066792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd0ec-e446-4de3-b31a-00b04d9ae0ab None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.067367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd0ec-e446-4de3-b31a-00b04d9ae0ab None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.067367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd0ec-e446-4de3-b31a-00b04d9ae0ab None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.068962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 167/335] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:01.075319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cc6b5-f5d0-41bf-82cf-7f88e20cb66f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.075752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cc6b5-f5d0-41bf-82cf-7f88e20cb66f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.075847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cc6b5-f5d0-41bf-82cf-7f88e20cb66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.099329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2b1cc6b5-f5d0-41bf-82cf-7f88e20cb66f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:01.101073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2b1cc6b5-f5d0-41bf-82cf-7f88e20cb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:01.149248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:01.186577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 169/336] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 00:06:01.317148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46291-106f-4fd7-9571-8a93f15807a1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.317483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46291-106f-4fd7-9571-8a93f15807a1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.317699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c46291-106f-4fd7-9571-8a93f15807a1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.319361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 168/337] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:01.324655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ea7bd-4645-4b77-a386-1002ee1f5c93 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.324939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ea7bd-4645-4b77-a386-1002ee1f5c93 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.325209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ea7bd-4645-4b77-a386-1002ee1f5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.354856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-530ea7bd-4645-4b77-a386-1002ee1f5c93 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:01.357449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-530ea7bd-4645-4b77-a386-1002ee1f5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:01.444856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 170/338] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:01.462983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408918ce-2666-4745-8901-022026756361 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.463280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408918ce-2666-4745-8901-022026756361 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.463532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408918ce-2666-4745-8901-022026756361 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.464871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 169/339] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:01.470159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.470442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.470716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.489979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:01.491694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:01.517455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1133e-107f-468e-8b5c-53587e325194 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.517759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1133e-107f-468e-8b5c-53587e325194 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.518043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1133e-107f-468e-8b5c-53587e325194 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.519377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 170/340] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:01.524397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.524677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.524947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.545755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:01.547004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:01.583676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:01.585411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 171/341] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:01.625958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 171/342] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:01.657680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:01.700930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:01.798127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660436ee-559a-4d5a-ab81-054355978d17 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:01.839320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:01.839955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:01.840232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:01.840496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:01.854243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:01.859050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:01.859933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:01.860742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 172/343] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:01.877619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:01.897342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.019038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988fee-9954-4408-90c0-0ad7680a8e18 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.056486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.057012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.057146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.057366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.057640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.058513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:02.058820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.060272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.065505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7865a-cec0-4c8c-96d2-98537d7f093d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.070896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 172/344] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:02.071798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.106753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.110644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.111854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.112306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.112746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.124968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:02.131136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:02.132069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:02.132862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:02.135184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 173/345] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:02.136309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.181185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bcbf2-ba43-439d-bd6f-9edf4bd498d2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.219107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.220125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.220600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.221064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.232562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:02.239455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:02.240371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:02.241297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:02.248504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 173/346] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:02.248627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8bdf-12f4-465c-8e19-5a6cf439f0b7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.249694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.290332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.290867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.291150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.291427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.318264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.349384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.361578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16068b2-987e-4369-a24b-5664facdeca1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.368540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.370398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.399220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.400224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.400774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.401245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.402172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:02.404690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.406441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.416256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 174/347] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:02.418674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.488160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 174/348] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:02.488978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.532564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096da4c-7b39-4086-bc66-4b633a6ce19b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.545872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.569611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.570622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.571111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.571601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.583668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:02.590010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:02.590907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:02.591730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:02.594166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 175/349] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:02.595279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.603508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100352fa-c78c-48b1-8b89-5fb906f32af9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.612513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.643128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.643962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.644412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.644824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.645773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:02.646241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.648428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.657810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 175/350] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:02.658818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.711067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f31b23-faf1-4e23-a9f4-5804d5e30970 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.745918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.746791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.747114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.747488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] PATH_INFO: `/v3/users/fca598d697cf4302bf684e9117d7aec2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.748775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] RBAC: Authorizing `identity:get_user(user_id=fca598d697cf4302bf684e9117d7aec2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.750380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.752075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 176/351] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/users/fca598d697cf4302bf684e9117d7aec2 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:02.752994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.768772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7d53-6634-438b-ad5a-d337fe8bbf4d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.786189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.809529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.810130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.810410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.810687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.811949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.813424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.816633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 176/352] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:02.817444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.842947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.861753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c35761-cb7f-49f6-8f14-081ffb659978 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.903430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.904040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.904365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.904638 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.905301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:02.905602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:02.907030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:02.918971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 177/353] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:02.919954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:02.933701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be643341-b429-40a1-89e3-40a91bc8aa50 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:02.970802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:02.971422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.971800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.972077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.025680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a9a47-686d-4c8b-b867-7dee00e8966e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.028856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.051725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.053395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.061764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.062358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.062634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.062906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.063632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] RBAC: Adding query filter params (role.id=be1578bb984d43c4bc09c0d2651cbd7a, user.id=fca598d697cf4302bf684e9117d7aec2, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:03.064073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.065515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.078258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 178/354] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/role_assignments?user.id=fca598d697cf4302bf684e9117d7aec2&scope.system=all&role.id=be1578bb984d43c4bc09c0d2651cbd7a => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.079104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.081931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.177070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 177/355] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:03.178013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.200014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9234f-f638-4a31-a073-1e46f8063aae None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.238627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.239318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.239597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.239914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.248123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.249601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.251325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 179/356] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.255998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.274289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.295197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390602-e622-486c-9480-0c1b20a19ff6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.329959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.334429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4409b-55d2-4bdf-81a1-02da977f6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.335430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4409b-55d2-4bdf-81a1-02da977f6eef None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.336192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4409b-55d2-4bdf-81a1-02da977f6eef None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.336473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4409b-55d2-4bdf-81a1-02da977f6eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.371511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46031607-e12a-4ee0-9569-c9a871ce0885 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.410511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.411147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.411424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.411695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.412864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.414356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.416000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 180/357] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.417290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4409b-55d2-4bdf-81a1-02da977f6eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.418804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4409b-55d2-4bdf-81a1-02da977f6eef None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.421370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.525860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.546011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 178/358] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:03.547724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1251eb-af3c-4c14-9894-2c14bb36f4c1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.548221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1251eb-af3c-4c14-9894-2c14bb36f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.548495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1251eb-af3c-4c14-9894-2c14bb36f4c1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.549908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 179/359] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:03.553099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1251eb-af3c-4c14-9894-2c14bb36f4c1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.559394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9ff2-1a94-43f3-93c5-c353cbed92c6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.602586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.603112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.603390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.603664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.604391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:03.604693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.607168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55200b68-2c9c-4ca6-b7af-59a7c2ec04cc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.609225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.615233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 181/360] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=0c368ffea6f0432c889772bf6f846afe => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.616864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.617149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.617424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.637498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:03.638778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:03.705664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1251eb-af3c-4c14-9894-2c14bb36f4c1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.726342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 182/361] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:03.727103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.749481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077217b1-ae06-40bc-873b-1061f4c1a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.750175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077217b1-ae06-40bc-873b-1061f4c1a21d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.750462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077217b1-ae06-40bc-873b-1061f4c1a21d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.750739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077217b1-ae06-40bc-873b-1061f4c1a21d None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.752186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077217b1-ae06-40bc-873b-1061f4c1a21d None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.754751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077217b1-ae06-40bc-873b-1061f4c1a21d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.761593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 180/362] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.763568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac4962-6387-4181-a2df-e54a25ffd71e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.763568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac4962-6387-4181-a2df-e54a25ffd71e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.763568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac4962-6387-4181-a2df-e54a25ffd71e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.763984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 181/363] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:03.770302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.770636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.770911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.791854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:03.793479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:03.851979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.852164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8813-5b06-4680-a529-910fdd0bf714 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.888584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.896205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 182/364] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:03.898406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.900349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.900995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.901271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.901540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.904459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.905942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.907571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 183/365] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.913719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.030152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014a09-0140-4440-a861-40e049f62ba6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.034691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfae0c9-11e7-47db-8bb2-0b7a5af44f5d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.079118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.079737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.080019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.080291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.081026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=ac488770b3384fcca78f291cdf2fc23c) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.081337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.082543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.082968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.083793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.084262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.084806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.086269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.087957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.088856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 183/366] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=cd08b79af819428e9e3cdde76343f11e => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.089669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.090765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 184/367] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.096325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.191883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.201754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.241951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470d1-3b8a-4144-9a7d-aa5ff73fb982 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.287620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d72dd-aae2-4bc2-a4f0-08241e66559b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.290464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.291397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.291677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.291950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.292692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.293000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.294472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.303160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 185/368] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=cd08b79af819428e9e3cdde76343f11e => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.307345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.341988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.342650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.342929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.343203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.357908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:04.364144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:04.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:04.366618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 184/369] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:04.371528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.492865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69739a09-5cb6-46fd-97a7-c88769dc7ac0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.494474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.500219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c67a3-89d0-4ba7-a329-18c8125df854 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.532645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.533259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.533539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.533814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.534528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.534834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.536219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.543845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.546165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 185/370] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.551688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.553079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.554013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.554491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.558673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.570193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:04.577180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:04.578155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:04.578960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:04.581729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 186/371] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:04.604404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.666318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6445-07af-4e61-a6d2-982ebe6ffd22 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.703301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.704096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.704473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.704860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.743003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.784797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd412-2579-4f2b-a920-6a9a773e0fe0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.801034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.802620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.851443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.852059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.852395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.852674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.853345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.853651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.855062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.875181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 187/372] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:04.880606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.960874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.019920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 186/373] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:05.025872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.071924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6dd2-3f09-4b58-88f9-53c8963e97da None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.127436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.128047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.128309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.128580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.150166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.228040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7285b-94c7-4e18-a057-70d4f7a052cd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.259888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.264382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.294107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.295178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.295663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.296130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.297629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.299289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.307296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 187/374] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:05.309506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.378143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.477205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 188/375] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:05.485831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b69a7-3122-4372-b8ec-d2eef49f63c4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.486827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.524541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.536390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.537030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.537305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.537598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.538827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.540281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.546257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 188/376] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.548536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.677456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac9b2-8048-42fa-af3d-d730e9a6c82b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.728227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.728851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.729126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.729398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.730157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=ac488770b3384fcca78f291cdf2fc23c) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:05.730464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.731893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.738177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 189/377] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=0c368ffea6f0432c889772bf6f846afe => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.754096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1911c-02cb-4b6b-9470-36767bebedf5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.809884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906b89b-51d2-48c7-aab4-88058e598172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.810455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906b89b-51d2-48c7-aab4-88058e598172 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.810731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906b89b-51d2-48c7-aab4-88058e598172 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.811003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906b89b-51d2-48c7-aab4-88058e598172 None admin] PATH_INFO: `/v3/projects/bd522a8547c94161b0d64079ee82f079` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.815986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906b89b-51d2-48c7-aab4-88058e598172 None admin] RBAC: Authorizing `identity:get_project(project_id=bd522a8547c94161b0d64079ee82f079)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.815986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906b89b-51d2-48c7-aab4-88058e598172 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.816723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 189/378] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/projects/bd522a8547c94161b0d64079ee82f079 => generated 344 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.822316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.924663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.974534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b199439-e700-4bdf-a563-64a1a8746ceb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.974748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99728-19de-40cf-93c1-ab5879726061 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.974932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99728-19de-40cf-93c1-ab5879726061 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.975248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99728-19de-40cf-93c1-ab5879726061 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.976586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 190/379] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:05.982365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.982646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.982918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.016568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.017528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.018048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.018466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] PATH_INFO: `/v3/groups/cf271f37d9fa4e7987cb1c10cfe41ec3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.020242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:06.021457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:06.030155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] RBAC: Authorizing `identity:get_group(group_id=cf271f37d9fa4e7987cb1c10cfe41ec3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.031912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.034542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 190/380] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/groups/cf271f37d9fa4e7987cb1c10cfe41ec3 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:06.040691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.045137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:06.160887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 191/381] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:06.222304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd1b0-4a59-4964-87d8-aaa50e8d876e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.251534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:06.261468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.262110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.262387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.262660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.263389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] RBAC: Adding query filter params (group.id=cf271f37d9fa4e7987cb1c10cfe41ec3, role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=bd522a8547c94161b0d64079ee82f079) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:06.263694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.265205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66415708-bae4-44dc-b763-8acc639e0287 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.274860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 191/382] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/role_assignments?group.id=cf271f37d9fa4e7987cb1c10cfe41ec3&scope.project.id=bd522a8547c94161b0d64079ee82f079&role.id=7c753c584d524b31b4742805d7365f68 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:06.507233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.644587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54453875-4e8b-4f87-8bfa-3f05ff26479f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.668285 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05400a-ff5e-460f-9e7f-c60445c6a533 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.668894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05400a-ff5e-460f-9e7f-c60445c6a533 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.669368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05400a-ff5e-460f-9e7f-c60445c6a533 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.671187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 192/383] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:06.677177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.677757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.678854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.688208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.688842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.689122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.689401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.707336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:06.710156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:06.711364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:06.712403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:06.713270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:06.714115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 192/384] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:06.719311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.734663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:06.808133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 193/385] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:06.876268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f8bc0-b1c8-411b-ac70-2021223f4a66 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.913101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.913710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.914024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.914296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.915041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:06.915327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.916763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b812c6-ba7a-416b-ad12-75d1e9000158 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.925676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 193/386] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:06.931832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.036658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3c432-78dc-4ae1-aea6-c91cc47b0614 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.036974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3c432-78dc-4ae1-aea6-c91cc47b0614 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.037205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3c432-78dc-4ae1-aea6-c91cc47b0614 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.039407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 194/387] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:07.050932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d5566-1c13-4dee-8bab-582fbc943726 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.054168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.054571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.054943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.080668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:07.082146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:07.098479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.121119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.121119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.121119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.121119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.130718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:07.132253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:07.134291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 194/388] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:07.140711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.167513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.174332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 195/389] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:07.248406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.285712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664085c-8968-43f5-b78d-6d881275aee4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.370625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.371175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.371451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.371720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.373335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:07.374810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:07.377255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fc23-34e5-4e93-a186-6ac34b7bb6fa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.388728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 195/390] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:07.391620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.448291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.448937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.449213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.449483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.475082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:07.480006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:07.480870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:07.481651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:07.486292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 196/391] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:07.487881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.493242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.533153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2caa514-68c0-441d-9754-e1444d024831 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.571310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.571982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.572268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.572544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.574955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fb5124457bf44bfb8a2e4343e037ac7, group_id=6d7d5c8b4cbc433daefe9e2c8baf631a, role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:07.576419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:07.580195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.597973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 196/392] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:07 2022] PUT /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/0c368ffea6f0432c889772bf6f846afe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:06:07.616941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.633287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542290-6fa2-4866-a02b-66b952fdb357 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.672902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.673512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.673788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.674088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.674762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:07.675065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:07.676506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:07.686657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 197/393] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:07.696211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.769205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b89f3-8489-412c-b1fb-6fd2324c6c58 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.802217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.811163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abde5a6-ac5f-43a2-a863-3114059f1fa0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:07.827574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.828227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.828512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.828782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.836821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:07.851398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:07.852033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:07.852163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:07.852324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:07.852580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:07.853767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:07.855440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:07.857456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 198/394] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:07.858046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:07.858890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:07.859703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:07.863408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.864426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 197/395] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:07.870046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:07.979706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566f834-0c14-4c88-ade8-be4da37a8158 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.019277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.019926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.020206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.020483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.021648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.023675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.025307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 199/396] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:08.030882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.031448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d6e8f-54c1-4f38-9b68-0db0a251e8b3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.073143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.073801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.074109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.074428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.075105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:08.075402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.076802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.086739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 198/397] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:08.092902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.103928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.146359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.167900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9f5b-4ef0-4360-b768-d85735356b30 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.215710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7506f-ef45-4da6-a3ba-a99e406ae54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.216383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7506f-ef45-4da6-a3ba-a99e406ae54f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.216773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7506f-ef45-4da6-a3ba-a99e406ae54f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.216878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbc08a-989e-4b9d-83be-7d4e7f31675a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.216955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7506f-ef45-4da6-a3ba-a99e406ae54f None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.218974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7506f-ef45-4da6-a3ba-a99e406ae54f None admin] RBAC: Authorizing `identity:create_grant(project_id=ac488770b3384fcca78f291cdf2fc23c, group_id=6d7d5c8b4cbc433daefe9e2c8baf631a, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.221649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7506f-ef45-4da6-a3ba-a99e406ae54f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.243004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 200/398] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:08 2022] PUT /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:06:08.244153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b75242-456b-4309-be4f-149681fbe680 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.244439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b75242-456b-4309-be4f-149681fbe680 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.244716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b75242-456b-4309-be4f-149681fbe680 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.246011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 201/399] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:08.251694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.251992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.252246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.283927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.284609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.284888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.285161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.286364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:08.286496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.287642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:08.288412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.290498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 199/400] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:08.296082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.391435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 202/401] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:08.452113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0a3cd-771c-409c-9b39-4c57675c3bc5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.471999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.505269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.505827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.506125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.506924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.513886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.513886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.514400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 200/402] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:08.519972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.596060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.661080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa740-2b25-4aa5-8f8f-2f99363dc9c3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.708518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38f72-5ea9-4c63-bf70-e7ec6a8d441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.709191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38f72-5ea9-4c63-bf70-e7ec6a8d441f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.710065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38f72-5ea9-4c63-bf70-e7ec6a8d441f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.710342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38f72-5ea9-4c63-bf70-e7ec6a8d441f None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.712339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38f72-5ea9-4c63-bf70-e7ec6a8d441f None admin] RBAC: Authorizing `identity:create_grant(project_id=0fb5124457bf44bfb8a2e4343e037ac7, group_id=6d7d5c8b4cbc433daefe9e2c8baf631a, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:08.713792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38f72-5ea9-4c63-bf70-e7ec6a8d441f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:08.745654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 203/403] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:08 2022] PUT /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:08.753468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.902773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213091-f5ae-4736-aa54-f08f407a3dc7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:08.944602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:08.945255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.945590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.945879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.952215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c9da-0015-4905-b989-04b747d5ce70 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.952500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c9da-0015-4905-b989-04b747d5ce70 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.952758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c9da-0015-4905-b989-04b747d5ce70 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.954443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 204/404] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:08.961283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.961572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.961816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.965141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:08.971903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:08.972854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:08.974186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 201/405] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:08.979927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:08.997195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:08.998425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:09.039276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.082527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 205/406] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:09.103140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecf0f1-de55-42b0-8209-e16eaf37572b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.145453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.146018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.146295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.146567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.147261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:09.147576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.148936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.157722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 202/407] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.163591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.220641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.306509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928bd1-3ccc-475f-97f9-c7a66a0c1170 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.344068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.345090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.345569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.346077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.347431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.349082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.351729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 206/408] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.358140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.398672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.555099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.560583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e810b-8cfc-436f-b13b-7777cc9fe687 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.588001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8719b-8d41-4544-86a4-421c7c3e43b5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.603003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.629541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.630201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.630474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.630742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.632857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.634350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.639410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 203/409] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.646434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.653645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.654245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.654521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.654789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.679930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:09.685310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:09.686234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:09.687051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 207/410] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:09.692812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.810530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a9f3-10bd-48b3-8503-26814dd89798 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.888875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.890871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.893984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.894473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.897044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac488770b3384fcca78f291cdf2fc23c, group_id=6d7d5c8b4cbc433daefe9e2c8baf631a, role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.899651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.917806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf1ad-fe5b-4bc0-a173-6c946a1da0a3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.921914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 204/411] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:09 2022] PUT /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c/groups/6d7d5c8b4cbc433daefe9e2c8baf631a/roles/0c368ffea6f0432c889772bf6f846afe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:09.975677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.976714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.977191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.977658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.978572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:09.979083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.980807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.994874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 208/412] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.001045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.042051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.128915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bee42-ef35-47f9-b95e-c9f8af2e93b7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.166864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.168106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.168598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.169080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] PATH_INFO: `/v3/groups/cf271f37d9fa4e7987cb1c10cfe41ec3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.170430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] RBAC: Authorizing `identity:get_group(group_id=cf271f37d9fa4e7987cb1c10cfe41ec3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.172163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.173982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 205/413] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/groups/cf271f37d9fa4e7987cb1c10cfe41ec3 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.182859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.227304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.322087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0a60a-91f1-4cdd-bf82-6fdb6286edee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.368897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9369e-36f1-45a5-939b-d8e07e3725c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.369530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9369e-36f1-45a5-939b-d8e07e3725c1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.369810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9369e-36f1-45a5-939b-d8e07e3725c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.370108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9369e-36f1-45a5-939b-d8e07e3725c1 None admin] PATH_INFO: `/v3/projects/bd522a8547c94161b0d64079ee82f079` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.373205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9369e-36f1-45a5-939b-d8e07e3725c1 None admin] RBAC: Authorizing `identity:get_project(project_id=bd522a8547c94161b0d64079ee82f079)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.374875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9369e-36f1-45a5-939b-d8e07e3725c1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.376623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 209/414] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/projects/bd522a8547c94161b0d64079ee82f079 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.383106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.393257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1efb2-94d1-4ed7-a8f9-24e395408c3d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.393539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1efb2-94d1-4ed7-a8f9-24e395408c3d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.393820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1efb2-94d1-4ed7-a8f9-24e395408c3d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.395572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 210/415] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:10.406070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.406350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.407147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.428862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:10.430014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:10.546370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 211/416] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:10.576662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.584158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce925bb5-3a58-4afc-87ab-75de1457b266 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.620704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a088-6642-47b9-833f-6a99e92ac053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.621361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a088-6642-47b9-833f-6a99e92ac053 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.621639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a088-6642-47b9-833f-6a99e92ac053 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.621944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a088-6642-47b9-833f-6a99e92ac053 None admin] PATH_INFO: `/v3/projects/bd522a8547c94161b0d64079ee82f079/groups/cf271f37d9fa4e7987cb1c10cfe41ec3/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.623987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83a088-6642-47b9-833f-6a99e92ac053 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd522a8547c94161b0d64079ee82f079, group_id=cf271f37d9fa4e7987cb1c10cfe41ec3, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.625429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83a088-6642-47b9-833f-6a99e92ac053 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.644675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 206/417] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:10 2022] PUT /identity/v3/projects/bd522a8547c94161b0d64079ee82f079/groups/cf271f37d9fa4e7987cb1c10cfe41ec3/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:10.901503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.918441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5673f3-fa02-41a5-92ec-5f768550068f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.919118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5673f3-fa02-41a5-92ec-5f768550068f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.919616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5673f3-fa02-41a5-92ec-5f768550068f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.921419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 207/418] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:10.926602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.927135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.927627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.938926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.966862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:10.968180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:11.025074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b05492-397a-4eb3-9a65-c2e489ad4933 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.065242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.066837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.067340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.067811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.080324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:11.086634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:11.087568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:11.088415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:11.091410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 212/419] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:11.097221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.135879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 208/420] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:11.207304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.226386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0d01-f598-45a3-9095-34c70eb9a422 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.261671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.263086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.263558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.264048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.264941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:11.265502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.267087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cee38-e65e-4ebd-8667-e71c2d3411e2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.276769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 213/421] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:11.282053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.318674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501a5a-ad14-4ca0-82f8-6bfb80926a2b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.319334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501a5a-ad14-4ca0-82f8-6bfb80926a2b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.319804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501a5a-ad14-4ca0-82f8-6bfb80926a2b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.321331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 214/422] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:11.326230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.326749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.327227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.347703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:11.349342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:11.392219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.421862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c175-33d8-4d4b-a2e1-c1a22872d9c2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.431406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 215/423] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:11.479770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.480747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.481243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.481708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.522984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.565305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.567733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.644128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.683329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.696835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f321a45-5e5c-4c72-bda7-5574151331a7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.704832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 209/424] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:11.711495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.744560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.745608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.745916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.746466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.760105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:11.767183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:11.768085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:11.768865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 216/425] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:11.775385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.827418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a5416-24c3-40e6-a420-a11937c10836 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.875520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.876492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.876976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.877460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.878923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.880949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.883847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 210/426] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:11.884984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.911645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043c907-8a41-4710-b02e-6f91b72c5411 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.950394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.951353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.951827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.952291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.953487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.959780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.966061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:11.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:11.972400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:11.973659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:11.975898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 217/427] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:11.976893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.003857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376529c0-aa88-4794-8339-43b0515e4b2b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.049643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.050289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.050574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.050850 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.051543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:12.052128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.054229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.069919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 211/428] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.071077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.095146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4527-700a-489d-866e-4e4f9cd6ddd8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.132269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.133099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.133470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.133903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.135137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.136763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.138498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 218/429] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.139345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.207313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bca73-eed5-42d8-90f6-30bc371d05ac None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.207939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.230231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.245917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3f1fd-75e4-4d03-893f-600c874fc3c5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.254463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.255283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.255763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.257473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.258363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:12.259129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.261002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.273693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 212/430] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.274899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.284018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb672af-d4c7-4bca-bb08-b19359304c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.284809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb672af-d4c7-4bca-bb08-b19359304c92 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.285180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb672af-d4c7-4bca-bb08-b19359304c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.285544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb672af-d4c7-4bca-bb08-b19359304c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.359729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb672af-d4c7-4bca-bb08-b19359304c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.361281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb672af-d4c7-4bca-bb08-b19359304c92 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.402779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56a075-8fa4-47de-ab02-19d8ac1f06dd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.433291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.446516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.447585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.447931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.448215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.448955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:12.449266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.451108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.458903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 213/431] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=0c368ffea6f0432c889772bf6f846afe => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.460444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.478112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 219/432] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:12.479828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085c10-5760-4d2a-a587-5679df5d36a7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.480328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085c10-5760-4d2a-a587-5679df5d36a7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.480819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085c10-5760-4d2a-a587-5679df5d36a7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.482745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 220/433] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:12.484183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085c10-5760-4d2a-a587-5679df5d36a7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.512393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.577689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccc866-9f34-4a34-a54a-ceb9cf8874e6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.605154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085c10-5760-4d2a-a587-5679df5d36a7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.616012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f1247-63a9-40e6-aaaa-23f683216575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.616638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1247-63a9-40e6-aaaa-23f683216575 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.616918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1247-63a9-40e6-aaaa-23f683216575 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.617198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1247-63a9-40e6-aaaa-23f683216575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.654195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d8d1d-014d-4f50-94b7-aa74201aed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.654832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d8d1d-014d-4f50-94b7-aa74201aed22 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.655106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d8d1d-014d-4f50-94b7-aa74201aed22 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.655374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d8d1d-014d-4f50-94b7-aa74201aed22 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.657309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d8d1d-014d-4f50-94b7-aa74201aed22 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.658803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d8d1d-014d-4f50-94b7-aa74201aed22 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.660644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 221/434] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:12.661584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.662002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.662150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.681472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:12.683617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:12.719482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f1247-63a9-40e6-aaaa-23f683216575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.720880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f1247-63a9-40e6-aaaa-23f683216575 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.723166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.767903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 222/435] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:12.768114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.769240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.851754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 214/436] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:12.853779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67bad-6c58-419d-882c-207a54f45b38 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.854091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67bad-6c58-419d-882c-207a54f45b38 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.855997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67bad-6c58-419d-882c-207a54f45b38 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.856557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 215/437] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:12.857727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67bad-6c58-419d-882c-207a54f45b38 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.876710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618ba3-3234-454e-aa1e-13bbcab324af None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.915929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91879e49-a290-4ea5-84d7-d04ea8bcb497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.916761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91879e49-a290-4ea5-84d7-d04ea8bcb497 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.917190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91879e49-a290-4ea5-84d7-d04ea8bcb497 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.918081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91879e49-a290-4ea5-84d7-d04ea8bcb497 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.919605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91879e49-a290-4ea5-84d7-d04ea8bcb497 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.921836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91879e49-a290-4ea5-84d7-d04ea8bcb497 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.924475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 223/438] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.926218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940755-7900-4861-a258-d9998fb9a94b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.926657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940755-7900-4861-a258-d9998fb9a94b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.927346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940755-7900-4861-a258-d9998fb9a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.950183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-39940755-7900-4861-a258-d9998fb9a94b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:12.951562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-39940755-7900-4861-a258-d9998fb9a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:12.966197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67bad-6c58-419d-882c-207a54f45b38 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.981596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.003582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.004216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.004475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.004944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] PATH_INFO: `/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.005900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] RBAC: Authorizing `identity:get_project(project_id=0fb5124457bf44bfb8a2e4343e037ac7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.007830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.014101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 216/439] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/projects/0fb5124457bf44bfb8a2e4343e037ac7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.014101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.025217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.032397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 224/440] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:13.033237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940755-7900-4861-a258-d9998fb9a94b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.128872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048bc5c-b342-41f6-987f-67c159f5ae36 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.146037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940755-7900-4861-a258-d9998fb9a94b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.165599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.166516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.167444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.167937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.169217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=ac488770b3384fcca78f291cdf2fc23c) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.169533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.171676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.185887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 217/441] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=cd08b79af819428e9e3cdde76343f11e => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.185887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.189622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.190390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.190780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.191156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.192450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.194619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.201600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 225/442] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.203144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.242638 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.274235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.309956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984ef4c-f0c3-4c0a-9386-2d4550db1642 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.339698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d60f-c583-46d1-9523-dd504a0dc991 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.350367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.351004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.351283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.351554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.365037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:13.371972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:13.372891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 218/443] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:13.373702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.383596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.384200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.384481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.384752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.385483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=cd08b79af819428e9e3cdde76343f11e, scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.385785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.387293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.398039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 226/444] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=0fb5124457bf44bfb8a2e4343e037ac7&role.id=cd08b79af819428e9e3cdde76343f11e => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.398039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.503516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.513870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373bc7e-b416-4c60-a928-669a2db0ff06 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.520463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef994-cb50-483f-8c83-d92190520fd4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.546744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.552411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.553184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.553462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.553734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.564467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:13.565707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.566359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.566641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.566908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.567608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.567916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.569291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:13.570655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:13.571567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:13.572355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:13.576802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 219/445] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:13.577710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.579009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 227/446] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.586273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.694497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ff3af-efc4-4391-b147-36310b5950d6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.704590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9537d-03cd-477f-8d76-39bf001909b2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.733197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.733809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.734131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.734408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.735069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:13.735373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.736762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.740247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.740886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.741170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.741432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.746175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 220/447] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.752043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.773128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.815738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.829288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.831469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.878568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d50b-079d-48e2-bce5-63e2d4da3758 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.933389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.934228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.934676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.935127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.965431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 228/448] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:13.971438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.011453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.012882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.033360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.076289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.091019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009aeb4-ad19-45d3-afca-ef9fd9f19b02 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.127775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 221/449] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:14.127989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.128428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.128703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.128973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] PATH_INFO: `/v3/projects/ac488770b3384fcca78f291cdf2fc23c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.130152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] RBAC: Authorizing `identity:get_project(project_id=ac488770b3384fcca78f291cdf2fc23c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.132153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.138202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 229/450] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/projects/ac488770b3384fcca78f291cdf2fc23c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:14.138327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.139093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.233211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9524a2-fff8-404d-a1be-2c6190af2259 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.233406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b5eb-5f30-4a98-a5c8-3d49aa542b21 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.257390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.268155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.268532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.268771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.269049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.269164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.269326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] PATH_INFO: `/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.269450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.269679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] PATH_INFO: `/v3/projects/bd522a8547c94161b0d64079ee82f079` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.270449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] RBAC: Authorizing `identity:get_group(group_id=6d7d5c8b4cbc433daefe9e2c8baf631a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.270884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] RBAC: Authorizing `identity:get_project(project_id=bd522a8547c94161b0d64079ee82f079)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.271914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.272311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.273623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 230/451] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/groups/6d7d5c8b4cbc433daefe9e2c8baf631a => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:14.274137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 222/452] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/projects/bd522a8547c94161b0d64079ee82f079 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:14.279144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.279250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.303702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.377728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fae8be-d70b-4641-84c6-5102d1781e68 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.378696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7d1ef-ab64-4d42-94c8-324511db8c63 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.411059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.411645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.411918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.412011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.412186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.413039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.413316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.413403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] RBAC: Adding query filter params (group.id=6d7d5c8b4cbc433daefe9e2c8baf631a, role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=ac488770b3384fcca78f291cdf2fc23c) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:14.413588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] PATH_INFO: `/v3/groups/cf271f37d9fa4e7987cb1c10cfe41ec3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.413679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.414723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] RBAC: Authorizing `identity:get_group(group_id=cf271f37d9fa4e7987cb1c10cfe41ec3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.415129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daea868-29ad-4345-a110-52ef49274271 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.416149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.418036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 223/453] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/groups/cf271f37d9fa4e7987cb1c10cfe41ec3 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:14.425888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 231/454] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/role_assignments?group.id=6d7d5c8b4cbc433daefe9e2c8baf631a&scope.project.id=ac488770b3384fcca78f291cdf2fc23c&role.id=0c368ffea6f0432c889772bf6f846afe => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:14.426096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.519414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.529885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d236a-974e-4837-b075-19c76b1ee6e0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.565705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.565705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.566029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.566129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.566805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] RBAC: Adding query filter params (group.id=cf271f37d9fa4e7987cb1c10cfe41ec3, role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=bd522a8547c94161b0d64079ee82f079) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:14.567110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.569084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0758eb-8313-4bd5-88e0-015c82f17468 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.574819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 224/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/role_assignments?group.id=cf271f37d9fa4e7987cb1c10cfe41ec3&scope.project.id=bd522a8547c94161b0d64079ee82f079&role.id=7c753c584d524b31b4742805d7365f68 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:16.962839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929238f2-3cfd-4129-b999-9feeeb8231de None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.963779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929238f2-3cfd-4129-b999-9feeeb8231de None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.964275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929238f2-3cfd-4129-b999-9feeeb8231de None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.966065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 232/456] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:16.975164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04b85-b9ac-4e2d-9719-4e821d00b9ef None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.975164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04b85-b9ac-4e2d-9719-4e821d00b9ef None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.975164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04b85-b9ac-4e2d-9719-4e821d00b9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.998876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f3c04b85-b9ac-4e2d-9719-4e821d00b9ef None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:17.000293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f3c04b85-b9ac-4e2d-9719-4e821d00b9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:17.082549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 225/457] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:17.170708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78e872-cd67-4561-b89c-7693b470a54b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.171306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78e872-cd67-4561-b89c-7693b470a54b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.171796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78e872-cd67-4561-b89c-7693b470a54b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.173602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 233/458] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:17.176189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a157-d613-49e4-8780-5c8455b4b014 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.176477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a157-d613-49e4-8780-5c8455b4b014 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.176753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a157-d613-49e4-8780-5c8455b4b014 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.179012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 226/459] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:17.183305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.183719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.184004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.184238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.184340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.184810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.212592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:17.214763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:17.229359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:17.231132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:17.327464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 227/460] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:17.334254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.355059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 234/461] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:17.493560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.512529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.628775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a121c-39d3-4508-a42e-60c2eecfea9e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.667562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.673875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.673875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.673875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.673875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.684000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.685474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:17.703354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:17.704327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:17.705209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:17.705209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:17.705209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:17.705209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 228/462] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:17.712723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.784507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.806168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c10906-4e15-4d8d-a5ad-dd377ba2ad7b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.820986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7e92-a9bf-4516-9823-93c6fa28dd30 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.844172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.845182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.845601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.846127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.854481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.855084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.855360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.855628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.856271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:17.856562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.858917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfefe1-b4f0-40f5-bbf7-9eda21bdb45c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.859233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.860865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.873957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 229/463] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:17.875306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0b55-1e40-485b-a311-0d5d65ea65cb None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:17.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:17.879141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:17.879978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:17.879978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:17.879978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:17.880235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0b55-1e40-485b-a311-0d5d65ea65cb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.880235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b0b55-1e40-485b-a311-0d5d65ea65cb None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.882372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 235/464] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:17.882814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.886613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 230/465] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:17.887561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0b55-1e40-485b-a311-0d5d65ea65cb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.936895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.994598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b0b55-1e40-485b-a311-0d5d65ea65cb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.014914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec39155-8933-4d49-8fa0-f392ad887741 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.024137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.033662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.034293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.034616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.034837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.035475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.036919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.051445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.052094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.052393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.052665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.059278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 231/466] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:17 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:18.060303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.065122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.066630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2c700c3e-491a-4e05-bdb3-7f99c10e23a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:18.086303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:18.087313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:18.088195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:18.088195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:18.088195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:18.088195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 236/467] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:18.094292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.094292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.094292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.110274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:18.111489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:18.198361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 237/468] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:18.199444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.234251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.239834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87534e5f-53db-4425-abf7-15b9d6128345 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.276867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57138270-0981-48c2-9600-85876559d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.277480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57138270-0981-48c2-9600-85876559d952 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.277756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57138270-0981-48c2-9600-85876559d952 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.278055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57138270-0981-48c2-9600-85876559d952 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.278768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57138270-0981-48c2-9600-85876559d952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:18.278991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57138270-0981-48c2-9600-85876559d952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.280363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57138270-0981-48c2-9600-85876559d952 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.294295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 232/469] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:18.299579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57138270-0981-48c2-9600-85876559d952 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.335503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8cbe6-6087-4714-a959-b5f5d94ada21 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.345054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.380337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.381084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.381425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.381767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.382519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:18.382888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.384348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.398142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 238/470] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:18.402888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.421592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57138270-0981-48c2-9600-85876559d952 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.458803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.459679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.460101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.460540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.461336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.462962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.487020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 233/471] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:18 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:06:18.499443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.506419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.524282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e6f6-f521-49e6-a1ab-785ffbefaf5f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.563722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5cd75-7e12-4ee3-9234-fa7b7c522f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.564315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5cd75-7e12-4ee3-9234-fa7b7c522f62 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.564597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5cd75-7e12-4ee3-9234-fa7b7c522f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.564871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5cd75-7e12-4ee3-9234-fa7b7c522f62 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.565639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5cd75-7e12-4ee3-9234-fa7b7c522f62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.567160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5cd75-7e12-4ee3-9234-fa7b7c522f62 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.592316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 239/472] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:18 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:06:18.593669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462535-61d3-4959-a9db-f37290481b4f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.602465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462535-61d3-4959-a9db-f37290481b4f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.602917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13462535-61d3-4959-a9db-f37290481b4f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.604667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 240/473] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:18.611943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.612232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.612506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.643663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:18.644877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:18.652097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.660551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710368a-2002-4427-b82a-f9014e6159af None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.701093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.702124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.702591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.703033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.716352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.718149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:18.735234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:18.736207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:18.737060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:18.737060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:18.737060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:18.741439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 234/474] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:18.742945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.747886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 241/475] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:18.850813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4705bbe-974d-4aaa-9252-765dbe7dd2a2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.888203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.889177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.889718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.890210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.891056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:18.891547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.893114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.906529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 235/476] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:18.914987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.991846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.031172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebeacf0-9c4f-4c18-8791-94f1a714d4c1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.045506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.062691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.071499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.072111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.072392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.072666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.073318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.074804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.101422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 242/477] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:18 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:19.180072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a455-54a3-4d77-b23a-0ec96c17c135 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.225978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.226603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.226883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.227158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.227854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.229257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.238672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.sql.core [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:06:19.238672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:06:19.238672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [parameters: {'id': '9baa05f28f6245079bfed9920c4b9e39', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:06:19.238672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81516) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 31 00:06:19.256654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:06:19.257658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application yield resource Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise self.value Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application session.commit() Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:06:19.258805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:06:19.260208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:06:19.261461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:06:19.265999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [parameters: {'id': '9baa05f28f6245079bfed9920c4b9e39', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:19.267416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:06:19.268801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:19.270301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 236/478] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 00:06:19 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:19.270422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.407071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7a8a0-321c-46fa-b675-05d270980552 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.429714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.442718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eab7d-ffef-4442-8d7b-4ae10af83d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.443380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eab7d-ffef-4442-8d7b-4ae10af83d4d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.444164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eab7d-ffef-4442-8d7b-4ae10af83d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.444436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eab7d-ffef-4442-8d7b-4ae10af83d4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.454739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81eab7d-ffef-4442-8d7b-4ae10af83d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f81eab7d-ffef-4442-8d7b-4ae10af83d4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:19.460190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:19.461064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:19.462084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 243/479] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:19.467473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.549488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.579834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59efd-d24b-4125-92df-2122ce19b10d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.614903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.616046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.616323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.616588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.617249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:19.617546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.619031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56a35a-637e-4e30-a2d1-ab4f9a7ab3b7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.627844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 237/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:20.661291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e396-b630-48e9-b1cd-9dcfef44d4b6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.661801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e396-b630-48e9-b1cd-9dcfef44d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.661801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e396-b630-48e9-b1cd-9dcfef44d4b6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.663850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 244/481] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:20.672323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85717d0-ca57-4968-95ae-8eeca619a08c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.672323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85717d0-ca57-4968-95ae-8eeca619a08c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.672323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85717d0-ca57-4968-95ae-8eeca619a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.689543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a85717d0-ca57-4968-95ae-8eeca619a08c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:20.691045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a85717d0-ca57-4968-95ae-8eeca619a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:20.763253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 238/482] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:20.985215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faba36-0929-4214-9ec9-62d646b541fd None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.985835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faba36-0929-4214-9ec9-62d646b541fd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.986360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faba36-0929-4214-9ec9-62d646b541fd None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.988126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 245/483] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:20.994171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da142a-e0a1-48f1-8b6c-717671c96326 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.994682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da142a-e0a1-48f1-8b6c-717671c96326 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.995172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da142a-e0a1-48f1-8b6c-717671c96326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.014579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-73da142a-e0a1-48f1-8b6c-717671c96326 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:21.016086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-73da142a-e0a1-48f1-8b6c-717671c96326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:21.063295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faba36-0929-4214-9ec9-62d646b541fd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.084778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.096137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 239/484] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:21.118312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999ff7-68c1-4a2f-92e3-6853f63658ab None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.118970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999ff7-68c1-4a2f-92e3-6853f63658ab None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.119447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999ff7-68c1-4a2f-92e3-6853f63658ab None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.121258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 240/485] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:21.126616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.126897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.127170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.161363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:21.169424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:21.233765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faba36-0929-4214-9ec9-62d646b541fd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.293116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.293664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.293972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.294246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.296826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 241/486] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:21.307812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:21.313063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:21.313989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:21.314798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 246/487] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:21.319977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.414491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.452857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93faac7-b9e3-4917-a44a-0dff5e1ee471 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.484473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.489274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.490745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.491342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.491871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.492998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:21.493495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.495158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.504344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 242/488] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:21.509762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.519125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.614749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46293de-0d3c-4ca9-a122-7253806d4b14 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.617085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae194aa-483f-41a9-b6d8-f7f6f222dc9b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.650815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.651796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.652283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.652731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.664338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.666141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.673918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.674650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.675001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.675343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:21.683858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:21.685071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:21.685976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:21.685976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:21.685976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:21.685976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 243/489] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:21.686454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.690153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:21.695750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:21.696642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:21.697481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:21.700123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 247/490] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:21.705608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.734634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.809188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca364-846d-4bf3-91c1-492ebde4fcad None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.827565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121d0f-e518-4830-81e4-68f4c71beb63 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.829365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.857476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.858638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.859300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.859725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.868940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.869671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.870008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.870812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.871254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:21.871826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.873195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.875140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:21.882511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:21.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:21.884662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:21.887364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 244/491] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:21.888284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.894811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 248/492] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:21.895763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.004726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42dec3-90f6-48bc-ac61-94b254e796ec None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.024175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.028027 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d13f98-527e-4b7c-8f4a-a2748def830f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.044464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.045086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.045369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.045642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.046337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.046640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.048022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.056910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 249/493] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.062328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.070923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.071826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.072111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.072386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.073048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.073350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.074896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ae64-2576-4382-8131-c8d11652969a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.089409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 245/494] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.089409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d3ac9-ee62-49a4-8f2c-c9a860d5b3d0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.089409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d3ac9-ee62-49a4-8f2c-c9a860d5b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.089409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d3ac9-ee62-49a4-8f2c-c9a860d5b3d0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.089830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 246/495] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:22.091031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d3ac9-ee62-49a4-8f2c-c9a860d5b3d0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.094192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.175583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f67eb-9462-4d92-80ce-129caf5428ff None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.197199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d3ac9-ee62-49a4-8f2c-c9a860d5b3d0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.207799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.208416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.208690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.208983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.216014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.217464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.229218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.229860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:22.230061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:22.230975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:22.231868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:22.232379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.232379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.232506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 250/496] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:22.232506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.246093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.247573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0308317b-eef5-437f-a1eb-3367887f1aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:22.261549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:22.262679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:22.263700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:22.263700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:22.263700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:22.263700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 247/497] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:22.263967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9121e-c0b6-42ec-83dd-7b40b8ae8674 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.264167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9121e-c0b6-42ec-83dd-7b40b8ae8674 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.264444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9121e-c0b6-42ec-83dd-7b40b8ae8674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.282135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-95a9121e-c0b6-42ec-83dd-7b40b8ae8674 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:22.283312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-95a9121e-c0b6-42ec-83dd-7b40b8ae8674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:22.293250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.319822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.335873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3caa9-918e-45b2-90ef-0d7861290c58 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.350806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 248/498] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:22.352017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55684a19-99ff-442b-a417-ff384b318603 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.352294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55684a19-99ff-442b-a417-ff384b318603 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.352562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55684a19-99ff-442b-a417-ff384b318603 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.357778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 249/499] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:22.357778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55684a19-99ff-442b-a417-ff384b318603 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.374444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.375165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.375468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.375807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.386661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.388121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:22.402921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:22.403841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:22.404684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:22.404684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:22.404684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:22.404684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 251/500] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:22.404895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.469581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55684a19-99ff-442b-a417-ff384b318603 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.504595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.505131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.505413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.505709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.506485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.506741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033285bf-5e0b-4b94-83ff-755d8d181c0c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.506849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.508205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f4222-38fb-4966-abc8-f464dbb13cea None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.541206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.541810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.542100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.542369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.543004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.543303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.549160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.549302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 250/501] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.549302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.549302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.549302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.551630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.553817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.567737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 252/502] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.567737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.569089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:22.570513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:22.641813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 251/503] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:22.642741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.679799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dda61-a772-46f6-825c-452be6deaad2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.721215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.721739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.722048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.722321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.722955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.723255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.725118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.736764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 253/504] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.737387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.753578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd5262-8bc7-4edc-9e02-ebc59ba885de None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.785034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.791851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.792458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.792738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.793011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.800552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.844489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4208c6e-0f69-4e19-9987-188a41ad0f7a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.869819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.871359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.886011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.886642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.886919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.887191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.895718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.897218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:22.908336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:22.909242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:22.910162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 254/505] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:22.910732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.980299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 252/506] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:22.981133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.010550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ea851-f254-475f-9c25-eaf1f79a33c4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.011003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.028054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.045507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.046157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.046434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.046703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.057573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.059041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:23.073269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:23.074282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:23.075135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:23.075135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:23.075135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:23.075135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 255/507] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:23.075135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.081914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f74891-7c85-45f4-892e-aa5ad0169ce1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.118426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.119053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.119330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.119599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.126394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.127907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:23.141057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:23.142001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 253/508] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:23.142909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.176042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7d1b-edf9-4adf-9331-fa92d1b3ef63 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.209652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.210296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.210568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.210832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.220500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:23.225636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:23.226690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 256/509] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:23.227488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.235280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.245522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdf2a0-ef9a-49ed-96c5-a4f0bb6f8ca8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.255269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.278899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.279501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.279782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.280057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.280778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:23.281083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.282584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.298924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 254/510] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:23.300846 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.328532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9f0d8-2a45-4b71-afc5-13dac4aabb97 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.360606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.361228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.361507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.361779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.372577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.374080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:23.388391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:23.389299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:23.390559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:23.390559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:23.390559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:23.390559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 257/511] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:23.390792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.399614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe882f-3497-49b2-8eea-f4e290c86a3b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.433165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.433767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.434073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.434352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.434989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:23.435293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.436672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.448060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 255/512] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:23.448824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.460402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.468472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.487810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e76c94-dbc9-4e7c-a362-88b03a6f6f50 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.519506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.520105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.520383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.520653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.521414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:23.521719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.523185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.545455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9408f46-11ba-497f-8b1b-256d730dca3d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.559960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 258/513] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:23.560774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.583845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.584473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.584747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.585014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.585664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:23.585992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.587366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.595064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 256/514] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:23.595819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.656071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6ea3b-cf05-493d-ac9f-1e11286daa52 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.666810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.689663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.690289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.690569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.690848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.697565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e9208-1c5e-4bbf-b26a-f830b730be68 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.698897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.730239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.730829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.731102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.731370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.731993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:23.732290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.733651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.745539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 257/515] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:23.746285 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.757386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.758900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.844621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cafa8-ebcf-4c2d-aa4c-e91f53177464 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:23.854159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 259/516] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:23.855015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.880839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.886367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:23.886972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:23.887251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:23.887522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:23.888159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:23.889595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:23.895411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:23.910618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 258/517] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:23 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:23.911402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:23.971548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15beb7c-9dee-4db3-90b7-6a210513549a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.011859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.012716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.013157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.013611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.027364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37076f1-90df-4c45-a858-87d0e71dafea None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.070751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.071388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.071668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.071948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.085690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.087189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.089401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.091097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:24.103174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:24.104093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:24.104949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:24.104949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:24.104949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:24.104949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 259/518] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:24.105157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.135814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.148717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.204552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 260/519] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:24.205759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.219549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055fa5-3e58-4bbf-8aa7-4a2deac8ecd1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.253960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.254752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.255038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.255309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.262741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.264161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:24.276646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:24.277527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:24.278418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 260/520] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:24.278879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.317674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10def8-befa-4338-9eea-7c8fad76e9b6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.352811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.353656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.354107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.354610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.361495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.366477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.368676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.381333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:24.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:24.386006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:24.392943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:24.392943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:24.392943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:24.393110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d877f-4876-48b9-84a7-d74ca16833fa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.393187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 261/521] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:24.393187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.427025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.427660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.427941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.428219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.428858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:24.429159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.430601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.447901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 261/522] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.449038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.494187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc5f27-56d2-497d-b8f7-304291c221dc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.529448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.530046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.530323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.530608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.542580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.544461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.556717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d321-2bbe-409d-9773-d6015bcde88a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:24.560038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:24.560961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:24.561804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:24.561804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:24.561804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:24.561804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 262/523] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:24.562206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.598207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.598805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.599089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.599371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.600613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:24.600915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.602433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.606362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.624579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 262/524] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.625427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.647297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.667630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155145a-e37c-40e2-9ae8-52b3be59fac6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.701300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.702067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.702214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.702447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.703075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:24.703367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.704723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.717307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 263/525] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.718364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.733198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557ac2-8b90-4884-9606-4c1891567993 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.770820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.772236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.772668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.773083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.780499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.782180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:24.795201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:24.796221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:06:24.797389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:24.799569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 263/526] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:24.800427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.826086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf416a-8a13-46c7-94b2-a5e4caec7256 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.827726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.872240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.872939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.873337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.873705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.874481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:24.874850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.876373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.888382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 264/527] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.889284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.896505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.919140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd447aa2-017d-418f-9ff9-273025ce41a6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.957231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.958253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.958787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.959335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.960123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=5d50090e8a924a76b634807f00734c39) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:24.960435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.961907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.977888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 264/528] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/role_assignments?user.id=5d50090e8a924a76b634807f00734c39&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.977888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.016473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e72b9-d782-47ea-81ea-368aaa18701b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.061405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.062113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.062464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.062805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.070590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.072289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:25.085808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:25.086779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:25.087627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 265/529] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:25.088675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.108224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f884dc2-263c-4bda-b4ca-644d36e276b7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.116655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.168426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.169812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.169812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.171930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.171930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.172463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.174054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.202061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 265/530] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.203030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.206917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.216318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351bf77-2d12-406c-8a9c-70e42065b118 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.261429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.262162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.262445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.262770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.272926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.275039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:25.291676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:25.292731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:25.293787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 266/531] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:25.294387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.334406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa7aa6-d625-497c-8875-c6d1560e26ef None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.384013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.384784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.385159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.385529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.386358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.386763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.388312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.401729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 266/532] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.402774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.407860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.428372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58677f8-2d4c-4242-aad7-e36e046d2df0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.473449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.474424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.475352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.476326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.485142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.528143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02249b-da1c-4a8f-859a-6df2cdd1d44d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.565383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.567458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.568121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.568500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.568875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.569577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.569752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.570176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.571881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.586165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 267/533] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.586973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.657570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.682444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 267/534] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:25.682444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.703716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df4a96-021e-448d-b61f-fcb6b9612cb1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.732301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.746822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.747773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.748277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.748789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.749838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=f2440b4168f446639c4dd3761ea57438) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.750384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.752147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.759019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 268/535] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/role_assignments?user.id=f2440b4168f446639c4dd3761ea57438&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.760031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.815535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9f0b8-3f4b-45b3-82d1-d2dd3852e9f5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.878846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.879523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.879801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.880073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.881436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=cba449ceaf8746779958a1278e6d4cc2) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.881748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.883264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090cd1a-847b-4a0a-a34f-8cfeb7b6257e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.890476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 268/536] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/role_assignments?user.id=cba449ceaf8746779958a1278e6d4cc2&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.892151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c9be-f2bb-4725-a5ef-4c471632d3ed None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.892706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c9be-f2bb-4725-a5ef-4c471632d3ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.893203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394c9be-f2bb-4725-a5ef-4c471632d3ed None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.899740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 269/537] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:25.901635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.902216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.902792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.905804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e6b9-d87f-4764-a3a8-8dfbcc89b875 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.924971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:25.926760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:25.950502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.951163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.951440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.951710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.973057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.975242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:25.997385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:25.998359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:25.999197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:25.999197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:25.999197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:25.999197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 269/538] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:26.005467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.009027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.035758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 270/539] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:26.072768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.150606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602099ae-510b-4504-a524-9845dafe3039 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.188003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.188610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.188890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.189164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.189803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:26.190139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.191516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.204028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 270/540] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:26.212489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.324721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf958749-afe3-4880-904c-b6c32c249935 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.327503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.365507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.366222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.366498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.366827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.374045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.375870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:26.388758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:26.389627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:26.390502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 271/541] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:26.395749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.434821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.487882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.500025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec5aef-838f-43e9-97b3-263dcdb873d0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.517457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3cfc-2eb5-4495-9c36-b690abf1fc03 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.558781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.559395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.559681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.559955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.560656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:26.560960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.562542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.583157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 272/542] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:26.594219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.595884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.596580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.596854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.597167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.608738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:26.613706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:26.614600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:26.615956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 271/543] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:26.626830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.737896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5bb32-ee24-4e94-9245-09dd2ffc5191 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.788497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.790634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.791106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.791565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.792415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:26.794168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.798520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.813971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 272/544] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:26.820891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.831143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.847759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.847925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea59f9-1b2a-4692-98e8-c8c53dd9a0f1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.942562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.943233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.943516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.943790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.944218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e63c64-745b-40bc-a778-6c7ee4dd9ba0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.944640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=f83352aa0c3843e09f2a666b753a7b4a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:26.944811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.946383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.955964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 273/545] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/role_assignments?user.id=f83352aa0c3843e09f2a666b753a7b4a&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:26.982400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.983393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.983865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.984355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.997405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.999307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b1ae5ab3-f36c-42c0-84b9-91f040e66167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:27.015520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:27.016462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:27.017326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:27.017326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:27.017326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:27.019458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 273/546] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:27.026217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.142550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6512-413a-4fa4-9fce-8da2d0209de9 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.143172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6512-413a-4fa4-9fce-8da2d0209de9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.143638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6512-413a-4fa4-9fce-8da2d0209de9 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.145607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 274/547] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:27.149468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ca52a-d31b-4d02-b675-12e5c925a8b0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.150629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.150919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.151200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.190504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.190990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:27.191738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.192205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.192306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:27.192755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.193645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:27.194156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.196035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.211120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 274/548] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:27.217142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.241061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.286684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 275/549] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:27.354839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954c4b-6644-4456-a8da-9fd91a774839 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.394806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.395439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.395718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.395987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.410771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.412319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:27.427776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:27.429283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:27.430382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 275/550] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:27.437205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.444467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.559247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8024de3-e7e3-40b0-88f9-6f2d4ff308c0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.594899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.595850 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.596319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.596809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.597736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:27.598261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.599956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.618395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 276/551] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:27.624160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.665724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:27.740682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.761463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.799834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232845cc-294c-40bf-8034-22e84926c3ea None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.816483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671987c-6954-40b5-958a-01fbc70d3b4c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:27.869797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.870446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.870721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.870989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.893377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.894036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.894315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.894582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.916000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:27.921165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:27.922282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:27.923090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 277/552] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:27.934715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.012696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.014178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.110291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f109c2-5cbb-45c0-a023-76faa03b08d9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.147896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.150054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.175286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 276/553] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:28.181295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.195815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.196427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.196706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.196978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.197761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:28.198091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.199590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929d646-1c6f-4183-97a0-faf6e1e4af4d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.217312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 278/554] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:28.220723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7bca-d1bf-47bc-8536-06f1c0f1da04 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.221217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7bca-d1bf-47bc-8536-06f1c0f1da04 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.221690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7bca-d1bf-47bc-8536-06f1c0f1da04 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.223660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 279/555] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:28.225100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7bca-d1bf-47bc-8536-06f1c0f1da04 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.298942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbb956-3c04-4d76-b5c3-f4746cdbfe5f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.335356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7bca-d1bf-47bc-8536-06f1c0f1da04 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.341010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.342091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.342608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.343080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.354491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.356244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1d1bfe95-62f7-4282-bdb8-282764c545f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:28.377997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:28.379008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:28.383288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:28.383288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:28.383288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:28.383456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.383456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.383456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.383456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.383714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 277/556] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:28.383714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1928a38-71f1-4035-aaef-f42237656bba None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.383714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1928a38-71f1-4035-aaef-f42237656bba None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.383714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1928a38-71f1-4035-aaef-f42237656bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.394882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.397004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.402813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b1928a38-71f1-4035-aaef-f42237656bba None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:28.404402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b1928a38-71f1-4035-aaef-f42237656bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:28.411274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:28.413332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:28.414635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:28.414635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:28.414635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:28.414635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 280/557] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:28.414635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.436942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.449790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.482728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 278/558] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:28.484068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed66e-658d-4227-b036-b0af34f17ebe None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.484352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed66e-658d-4227-b036-b0af34f17ebe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.484627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ed66e-658d-4227-b036-b0af34f17ebe None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.490100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 279/559] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:28.490828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed66e-658d-4227-b036-b0af34f17ebe None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.542652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14afb4-2c1c-452e-b776-84aa81cfe940 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.577086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.577740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.578051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.578322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.579005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:28.579307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.580681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292963d-5c65-4aee-8149-f7b42578e4b0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.595383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 281/560] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:28.597361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.597547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.597869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.615759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ed66e-658d-4227-b036-b0af34f17ebe None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.621218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:28.622704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:28.652596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.653116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.653411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.653711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.654396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:28.654696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.656169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.668844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 280/561] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:28.669909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.697484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.714721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 282/562] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:28.715946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.745415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.810049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe5c52-b9ab-4776-9446-ba51b8a4ecfe None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.825089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604ef5e-f93d-4dc0-a118-5f542930a814 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.847566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.848254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.848455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.848723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.856070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.857519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.863041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.863914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.864405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.864972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:28.869435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:28.870775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:28.872144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:28.875568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 281/563] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:28.876448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.877357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.879058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:28.891845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:28.892844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:28.893770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:28.896349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 283/564] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:28.897429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.962942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.983338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00733f9a-35d3-4742-af2f-bfaac50a7b64 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.985596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.003161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75937-cc1b-415d-90c7-8d9c6a8540e1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.018576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.019202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.019477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.019746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.030936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:29.036124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:29.037086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:29.037972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 282/565] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:29.039211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.043419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.044032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.044310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.044578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.045266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.045567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.047010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.060780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 284/566] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.061385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.146737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f113b-0e67-4976-adb9-0468828570b3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.164795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68887db-cd17-487c-b294-4fb92c3faadb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.182217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.182900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.183075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.183345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.184073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.184375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.185807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.200976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.202055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.202648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.203118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.203358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.210329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 283/567] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.211344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.214906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:29.219791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:29.220786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 285/568] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:29.221646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.230470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.309186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e83ec8-32b9-4cdb-a007-49cfdc478a7b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.327354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdef75-f64e-4152-ab53-201971124fbd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.342582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.343173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.343445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.343712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.344364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.344660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.346053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.353570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 284/569] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.358746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.360863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.361491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.361769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.362069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.362786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=745d4cf142e24a7c9fb31af289f71fb6) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.363091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.364522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d92f9f-82d4-4af1-8df9-e9276195f1ae None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.375949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 286/570] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/role_assignments?user.id=745d4cf142e24a7c9fb31af289f71fb6&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.377434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da292e8-0558-460b-b1a5-c185579c2918 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.377711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da292e8-0558-460b-b1a5-c185579c2918 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.378027 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da292e8-0558-460b-b1a5-c185579c2918 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.379276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 287/571] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:29.380423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da292e8-0558-460b-b1a5-c185579c2918 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.452418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.479705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.495346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a692b-eebd-4803-b6fe-902aea96f538 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.524366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da292e8-0558-460b-b1a5-c185579c2918 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.535101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.535727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.536004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.536265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.548451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.550075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.565142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:29.565306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:29.566312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:29.567192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:29.567192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:29.567192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:29.567362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.567362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.567362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.567362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.567362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.569104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e510-f63d-460c-aaaa-fd9afa202693 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.571110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 285/572] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:29.571952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.582443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 288/573] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.583767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.584052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.584323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.602260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:29.603429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:29.681871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 289/574] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:29.681871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.689468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32424-f688-4442-b0b9-144d4269ea0a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.704038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.727706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.728448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.728788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.729121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.741338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.743032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.750610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:29.761397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:29.762385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:29.763270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:29.763270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:29.763270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:29.765981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:29.766972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.808149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03116d6d-d584-44ac-8998-e9f55d6b6398 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.848886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.850070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.850347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.850615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.851255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.851609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.852917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.869042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 290/576] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.870017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.891943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e29681-aa0a-4a0c-bab0-68de7d6f3558 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.928584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.929545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.930072 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.930540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.941946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.943705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:29.958342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:29.959842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:29.960725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:29.960725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:29.960725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:29.966165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 287/577] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:29.967217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.969580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917740f-66cc-4f64-b0aa-d9232aedb4e2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.989581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.991629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.007780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.008388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.008665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.008936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.009570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.009884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.011269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.023411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 291/578] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.024199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.081707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baaec0-095f-4a15-b0c7-3273e1ebc002 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.115825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.116631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.117082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.117492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.123839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c87e6-2644-4734-8d7a-0d8adf3352fb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.124315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.125965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:30.137189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:30.138303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:30.139363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:30.141297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 288/579] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:30.142229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.164841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.165467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.165719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.166009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.166648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.166948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.168301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.179553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 292/580] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.180337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.227379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.228214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.250856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fde1-06ff-4458-96e6-6e266defa6b8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.285586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.286446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.286856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.287126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.291031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d0080-ab51-423f-939b-4d3bb6a8ddd5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.297205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:30.302427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:30.303545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 289/581] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:30.304393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.340765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.341704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.342017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.342289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.350092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.351538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:30.362834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:30.364005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:06:30.365202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:30.368730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 293/582] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:30.369623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.432690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59039-dd1c-4979-a409-80fc94659b37 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.476312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.478234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.478846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.479139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.479404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.479739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7296fae-cc48-48fc-9fac-ffaa6c0ed5a1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.480083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.480388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.481813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.490721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.496758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 290/583] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.497796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.522100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.522702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.522981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.523248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.530830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.532281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:30.545426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:30.551142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 294/584] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:30.552866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.614811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50f8fe-6291-4c5e-bb48-2b55df196154 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.650793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.651391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.651668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.651940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.652590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.652809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df317b4-c9f9-475a-adba-db0b73ff98b0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.652905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.654265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.667912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 291/585] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.667912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.693196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.693944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.694288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.694638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.695470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.695840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.697342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.715459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 295/586] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.716462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.734739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.735153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.781590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245bd64-f696-496f-b4d3-66731650429b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.818324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.818987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.819280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.819542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/5d50090e8a924a76b634807f00734c39/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.829945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f94e3-1292-4321-8b97-44661011bcda None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.835356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=5d50090e8a924a76b634807f00734c39, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.836874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.851602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 292/587] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:30 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/5d50090e8a924a76b634807f00734c39/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:30.852345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.887061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.888178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.888583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.888931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.890029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.890471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.892893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.922027 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 296/588] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.923243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.997202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8a7e-7cb2-4cd6-83fc-3b9f9dbde056 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.012984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.029337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.049108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.050150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.050440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.050781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.062563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1304-5510-41ab-baf8-066d323701f0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.064060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.066040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:31.087768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.088939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:31.090296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:31.090296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:31.090296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:31.090296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 293/589] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.090828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.108468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.109451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.109982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.110459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.121886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.123596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:31.139330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.140349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:31.141243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:31.141243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:31.141243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:31.143336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 297/590] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.144389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.211209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01149342-3995-41c7-b01d-3437deb790c0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.247859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.248833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.249338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.249831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.261203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.263015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:31.280482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.281471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:31.282413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:31.282413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:31.282413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:31.282585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b00b9-1418-4a65-bb0d-488f9b70d30d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.284622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 294/591] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.285778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.303258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.314427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.323228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.323919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.324292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.324656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.325394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.325803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.327288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866e3e1-e83c-427c-94f7-8e4c486ef307 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.339192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 298/592] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.341898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef5046-fb5a-414f-bafa-aaceecd76ff3 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.341898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef5046-fb5a-414f-bafa-aaceecd76ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.341898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef5046-fb5a-414f-bafa-aaceecd76ff3 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.344163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 299/593] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:31.344163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef5046-fb5a-414f-bafa-aaceecd76ff3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.400417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6828-c8b9-4a91-bd0f-ad26e4281976 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.442592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.443781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.444066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.444456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.445100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.445405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.446811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.459419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 295/594] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.459691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef5046-fb5a-414f-bafa-aaceecd76ff3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.464434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.496284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.496889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.497362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.497606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.498710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.498710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.500065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f253-b720-4f57-9b2a-0a093eff2de8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.518225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 300/595] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.518225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.518225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.518225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.534626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:31.536037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:31.540892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.567605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e023eea-308d-4b3d-b4aa-837d3fcf4689 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.583203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.604609 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.605312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.605655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.606025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.608681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 301/596] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:31.613437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.616528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.619567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:31.629063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.630234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:06:31.631443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:31.637357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 296/597] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.637357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.751751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cb0a9-4f7d-4683-a602-0339340ed5e9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.756942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79e5c-9e2a-40de-84ed-f0579d81fdd1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.796714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.797139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.797780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.797954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.798329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.798503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.798773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.799088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.801776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.806421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.808127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.810135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.812104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:31.820425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.821562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:31.822708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:31.828674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 302/598] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.828674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:31.830312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.831378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:31.832497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:31.834124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 297/599] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.834971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.888097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.941350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fec2d-4382-4ece-9942-42318d6543b8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.953674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2881-7e01-4132-8e3a-8d18569ecff0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.977974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.978586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.978862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.979130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.979836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.980138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.981602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.990748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.991355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.991633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.991907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.992636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.992938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.994450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 298/600] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.995061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.999344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.017341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 303/601] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.022748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.051034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.100232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccfcac-8fe8-42fe-acc0-683fd490f3f3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.121671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.129245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8935b-0a74-4011-9850-1d64fd3f9e13 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.135757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.136748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.136748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.137069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.137865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:32.138182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.139600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.155858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 299/602] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.155858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.172315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.173022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.173783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.174093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.188813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:32.195012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:32.195909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 304/603] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:32.201594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.252177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e92ab-58cf-4ab5-8f24-f4400e6dcbef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.266003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.288443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.289095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.289473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.289755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/f2440b4168f446639c4dd3761ea57438/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.306444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=f2440b4168f446639c4dd3761ea57438, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.307896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.311975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab92c3-279d-40ac-93fb-61808a2ff30a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.322428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 300/604] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:32 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/f2440b4168f446639c4dd3761ea57438/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:32.334963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.362017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.362977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.364089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.364604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.381889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.383620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:32.405954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:32.406971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:32.407895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:32.407895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:32.407895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:32.410032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 305/605] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:32.411301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.429719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.480182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef4f0-03f5-4392-b620-b8f919983a72 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.519485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.519772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.520052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.520329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/cba449ceaf8746779958a1278e6d4cc2/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.537715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=cba449ceaf8746779958a1278e6d4cc2, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.540029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.557768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 301/606] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:32 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/cba449ceaf8746779958a1278e6d4cc2/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:32.558067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af2f2a-7680-4d86-b3d7-9ee0f22f89b5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.559052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.590142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.631244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.632545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.633288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.633570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.634281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:32.637629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.639258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.664366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 306/607] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.670048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.738868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b956f7-1ac3-4bfe-aaad-3465e4470d84 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.778332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.778919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.779264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.779456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.780166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:32.780474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.781919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.799565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 302/608] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.800844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.806352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.843496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a3db0-43e3-44a2-8b04-b73b81e3b4f8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.893267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.893753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.894755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.896748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.897195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.912652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.921401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a68a5-3d7a-4670-95e5-2550c9333b9a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-4c284828-8dd9-4916-a169-aae714c51cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:32.929607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:32.930626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:32.931812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:32.931812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:32.931812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:32.933917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 307/609] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:32.935352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf00bc-ea5b-4483-ab1c-c770478ee9b4 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.935831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf00bc-ea5b-4483-ab1c-c770478ee9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.936286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf00bc-ea5b-4483-ab1c-c770478ee9b4 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.937973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 308/610] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:32.939088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf00bc-ea5b-4483-ab1c-c770478ee9b4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.962068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.962693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.963018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.963290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.970379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.971832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3f51dd3e-e776-4b97-87e2-417734b5e6ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:32.983811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:32.984740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:32.985678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 303/611] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:32.986672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.986672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.986939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.005631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:33.006747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:33.058538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf00bc-ea5b-4483-ab1c-c770478ee9b4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.078077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 304/612] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:33.078996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.084384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.097506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.098556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.099091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.099568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.100422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:33.100951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.102583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.116533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 309/613] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:33.122713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.149908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.217473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95dca4-c9a9-4902-a280-fab063e0e08e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.278370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.278965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.279236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.279504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.280196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:33.280497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.281954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.293960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f6345-c81d-44e1-a3ef-b49599ef2b9b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.306799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 305/614] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:33.310522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.355838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.356485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.356732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.357004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.368408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.369865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:33.389133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:33.390186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:33.391153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 310/615] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:33.397018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.477622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4d964-ea66-4b19-9900-2fa281acf869 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.478194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.501612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.515147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.515546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.515826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.516153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/f83352aa0c3843e09f2a666b753a7b4a/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.530336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496642f-92ec-480f-8ba5-b0fcfc60c8d9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.532211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=f83352aa0c3843e09f2a666b753a7b4a, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.534221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.549494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 306/616] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:33 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/f83352aa0c3843e09f2a666b753a7b4a/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:06:33.550472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.572169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.573262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.573745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.574277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.575260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:33.575785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.577546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.626238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 311/617] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:33.632062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.741818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f48f5-2ed5-485e-a714-edd396923a7f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.788924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.790106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.791007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.791435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.795278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.804610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dcf1b-d5a7-4457-8e7b-cb71c7ffe04c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.805608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:33.811934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:33.812977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:33.813824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:33.821569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 307/618] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:33.823774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.865642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.906567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.907428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.907800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.908495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.942943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.944578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.947164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e91a9c-80bf-45e8-9253-185db845de24 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:33.971684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:33.973070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:33.974684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:33.974684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:33.974684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:33.982456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 312/619] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:33.987949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.989136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.990033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.990493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.990947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.991904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:33.992588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.995230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.009968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 308/620] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:34.012232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.121958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.130789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035bfe-ce32-4c79-848b-5cb75a83d629 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.171244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.172621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.173089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.173922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.186769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.188731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:34.205967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:34.206974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:34.207867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:34.207867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:34.207867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:34.210606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 309/621] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:34.216674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.238895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255303bd-fca7-4ef1-aba8-d8857ddd9760 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.295392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.295948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.296228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.296502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.297152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:34.297452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.298869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.311835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 313/622] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:34.317193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.343366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.346081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaa6db-da21-40bc-932d-6b2f43d564b2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.387626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.388241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.388524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.389052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.389709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:34.390046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.392329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5101f4-6c59-4116-b9fa-78d04285f9ce None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.406597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 310/623] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:34.408443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d879e0-5312-486d-9857-e9119565cc43 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.408728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d879e0-5312-486d-9857-e9119565cc43 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.409472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d879e0-5312-486d-9857-e9119565cc43 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.411294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 311/624] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:34.413299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d879e0-5312-486d-9857-e9119565cc43 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.425665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.475849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b40aa-79a9-4df7-b351-333ce027fbbf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.517334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.518354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.518712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.519519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.528701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.534767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-864390c4-5a25-4ca0-8d51-f3cc80580ccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:34.548324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:34.549238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:34.550209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 314/625] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:34.551167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.551167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.551403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.552721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d879e0-5312-486d-9857-e9119565cc43 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.570126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:34.571548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:34.599613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.600247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.600523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.600791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.612022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.613452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:34.626139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:34.627192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 312/626] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:34.628174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.664123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 315/627] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:34.665204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.667545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.739263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.780473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b29c-a198-4f77-961f-9bb5863144d9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.814194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b09054-72be-4cee-b971-036338c4fac4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.817093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.818475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.819076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.819569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.820498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:34.821004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.822739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42548dde-4293-460f-b9f9-d1a9c73ded98 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.842461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 316/628] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:34.844177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9ca6-8143-4de7-bb39-1ada4c75183b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.844713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9ca6-8143-4de7-bb39-1ada4c75183b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.845188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9ca6-8143-4de7-bb39-1ada4c75183b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.846967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 317/629] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:34.847989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9ca6-8143-4de7-bb39-1ada4c75183b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.856393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.857006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.857282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.857550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.858287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:34.858592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.860132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b240a03-7e72-4c33-9363-76998e674fb3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.873524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 313/630] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:34.879097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.879311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.879589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.900270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:34.901560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:34.918350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.964403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9ca6-8143-4de7-bb39-1ada4c75183b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.982158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 314/631] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:34.983257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.003096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.004058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.004590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.005255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.057595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.088901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.091257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.106071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b53215-6d7b-4495-b015-f5e0265490c0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.154817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.156158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.156768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.157149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.157540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/745d4cf142e24a7c9fb31af289f71fb6/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.178357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=745d4cf142e24a7c9fb31af289f71fb6, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.179824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.193669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 315/632] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:34 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/745d4cf142e24a7c9fb31af289f71fb6/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:35.194649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.208047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 318/633] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:35.215162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.310382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498d62-b068-4797-b2a0-103b51631a21 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.321571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.352209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.352764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.353151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.353418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.362977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9690e-729c-4239-b385-032a6ac911be None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.366258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:35.371305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:35.372322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:35.373168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:35.377701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 316/634] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:35.379037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.407303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.408391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.408890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.409357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.422053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.423973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:35.441498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:35.442605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:35.443728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:35.443728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:35.443728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:35.445112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 319/635] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:35.446049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.466656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.488948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bd754-6359-418a-8c94-450ef9315aff None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.523916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.524547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.524825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.525095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.535743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:35.541571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:35.542556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:35.543382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 317/636] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:35.544142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.566374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6510a-e663-4cfd-b05d-e60bb58a00ff None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.577421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.605603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.606534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.607036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.607554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.608384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:35.608858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.610604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.620914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 320/637] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:35.622048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.670867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936bb8a-8f10-49a2-80d8-5733c1d2a474 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.706695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.707414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.707755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.708098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.708567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.708868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:35.709235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.710723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.723523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 318/638] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:35.725054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.733359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae9466-fa3f-43dc-92eb-429225bd57d2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.768667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.769277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.769563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.769879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.770541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:35.771381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.772781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.785620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 321/639] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:35.786618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.819918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.834171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406515-eda8-4c07-a79f-4013af216b56 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.870143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.870783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.871057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.871331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.882025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.883463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.898625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e13d5a-8142-4436-b363-b6382122d7bb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:35.899171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:35.900081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:35.900969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:35.900969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:35.900969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:35.900969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 319/640] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:35.901201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.939165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.939789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.940068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.940341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.943452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.947909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.949480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3af8f2e9-3656-42f0-8e77-ac6c7f550727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:35.962852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:35.963854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:35.964796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 322/641] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:35.965333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c15c5-a85f-46df-b479-6fb99031cfdb None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.965333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c15c5-a85f-46df-b479-6fb99031cfdb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.965894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c15c5-a85f-46df-b479-6fb99031cfdb None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.970028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 323/642] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:35.970028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c15c5-a85f-46df-b479-6fb99031cfdb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.010868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0a2f2-fe48-4cfa-ba72-ce1806fcc6fc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.045865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.046702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.047145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.047557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.057062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.059646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.061433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:36.076607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.077767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:36.078875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:36.078875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:36.078875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:36.078875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 320/643] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:36.078875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.085781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c15c5-a85f-46df-b479-6fb99031cfdb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.121080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.121594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.121892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.122169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.122802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.123103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.124467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6d4d2-16b9-46de-810d-306a5d39a38d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.137016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 324/644] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:36.138181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.138475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.138748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.157227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:36.158447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:36.191138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33d7cf-c5a3-49b4-a972-157bd9fd6aad None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.212242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.226826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.227605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.227717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.227969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.228715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.228971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.230438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.231974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 325/645] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:36.234704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.247808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 321/646] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:36.248691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.304646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.355067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b97427-479a-474d-ab3a-28962013ce49 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.373189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5ed6d-9067-435f-a273-e3046bb12c06 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.402929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.404435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.404931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.405673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.412410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.413113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.413461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.413811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.414582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.414969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.416386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.416526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.418548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:36.434321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.435345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:06:36.436284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:36.436836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 326/647] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:36.436836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.438703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 322/648] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:36.439644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.505109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.563067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0325d-b164-4c0f-9a51-b85e72a46895 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.578565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9283c3-08db-4ea5-94f6-5c2406d2d812 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.592039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.600674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.601401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.601750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.602061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.602786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=5d50090e8a924a76b634807f00734c39) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.603094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.604585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.610375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 327/649] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/role_assignments?user.id=5d50090e8a924a76b634807f00734c39&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:36.611150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.626581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.629203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.630425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.631194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.647208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.649588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:36.669603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.670655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:06:36.671603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:36.679092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 323/650] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:36.679092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.738731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b0401-d6ef-437d-bc21-3a6f7abb65d6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.752934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.789796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.790433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.790717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.790986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.791801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.792020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.793449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.811484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 328/651] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:36.812333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.813314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418223-7c95-4e89-b3dc-bc2e58035d35 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.865150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.867410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.867771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.868327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.882043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:36.887686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.888757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:36.889594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:36.890952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 324/652] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:36.890952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.937402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.947476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092666a-a3b6-47eb-a4f3-93e1ecf4d4d4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.991403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.992583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.992917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.993199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.994432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.994744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.996932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.017273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b3328-0dea-4081-929f-3f97504a220a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.021171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 329/653] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.022207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.058105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.064997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.065601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.065899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.066171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.139078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.140437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.172292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdbe4-a128-47b3-b7cc-503c9f5e03e3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.187400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.211851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.212849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.213381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.213798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.214660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:37.215108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.216817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.226377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 330/654] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.227624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.265426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 325/655] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:37.266474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.324365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.337982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2f892-4dd7-4252-92af-afd39c9be5c5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.374546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909723-9f06-4a8f-8ddf-e2c81eed8ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.375161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909723-9f06-4a8f-8ddf-e2c81eed8ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.375429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909723-9f06-4a8f-8ddf-e2c81eed8ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.375697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909723-9f06-4a8f-8ddf-e2c81eed8ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.381084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ba0f-550e-4809-8a55-c832e564f89f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.418237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.424399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.425154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.425435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.425707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.436524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.438223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.452660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909723-9f06-4a8f-8ddf-e2c81eed8ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.454168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909723-9f06-4a8f-8ddf-e2c81eed8ca7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:37.454778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:37.455714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:37.457280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:37.457280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:37.457280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:37.457280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 326/656] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:37.457280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.551512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.571840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 331/657] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:37.571840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877b7a5-96ab-461d-aefb-c9e69fa23707 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.572110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1a2c-9d9e-46f5-ad19-f5b9f5eb43f3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.572234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877b7a5-96ab-461d-aefb-c9e69fa23707 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.572234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877b7a5-96ab-461d-aefb-c9e69fa23707 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.572234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 332/658] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:37.572234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877b7a5-96ab-461d-aefb-c9e69fa23707 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.608520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.609259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.609538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.609869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.621336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.623052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:37.641614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:37.642716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:37.643620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:37.643620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:37.643620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:37.643620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 327/659] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:37.643620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.688775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877b7a5-96ab-461d-aefb-c9e69fa23707 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.691842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.726512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.727117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.727398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.727687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.728305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:37.728607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.730040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d094d-637a-40a3-bd34-fa2746a72f0c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.742782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 333/660] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.744002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.744288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.744564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.762563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:37.764464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:37.775183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c477a5-bdf0-4de2-b2ce-e41f1d5e4ea0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.810542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.819446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.820174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.820677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.820862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.832752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.834714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.846386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 334/661] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:37.846386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:37.868903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:37.870077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:37.871166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:37.871166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:37.871166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:37.871166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 328/662] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:37.871166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.960631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7380ed-c1fd-4d59-a99c-062a1c3b63f3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.993464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.010478 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.011191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.011529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.011875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.012588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015892f-09ba-4d97-b0dc-fcd557a20442 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.012706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.013003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.014487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.030809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 335/663] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.030809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.055120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.056190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.056608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.057046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.064760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.066418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.073839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:38.078335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:38.080368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:06:38.081316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:38.087411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 329/664] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:38.088391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.140043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9280d-84ce-47ed-96eb-adc33ccdc56f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.174918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.175519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.175796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.176065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.176753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.177046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.178467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.196015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 336/665] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.196015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.201428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bbe3f-16a4-4d91-ac30-a41a36bee015 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.238677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.239306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.239610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.239883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.246715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.248157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:38.259201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:38.260141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:38.261022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:38.265143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 330/666] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:38.265995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.278857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.299169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.305453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f116-c5c5-47e2-a114-7463fce1620b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.349528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.350414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.350759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.351432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.352492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.352868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.354836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.368928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ce91c-04d2-466c-8bef-b4182a5923ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.378163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 337/667] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.379054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.409393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.410083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.410534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.410668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.423199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:38.429036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:38.429996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:38.431129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 331/668] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:38.432534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.489502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a8f14-fbed-437c-ae7e-3d125036912a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.501928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.525177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.525805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.526125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.526397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.533066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.534545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.540485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23068d7-72d8-4883-8ac8-bc502bbc6e58 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:38.546540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:38.547580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:38.548679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:38.552526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 338/669] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:38.553368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.576489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.579426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.580205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.580628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.581387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.582263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.582722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.584409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.596800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 332/670] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.597777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.666453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bb54e-8fcb-4321-a4c4-93f849e4c5d9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.700533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512282a4-ede7-4720-be42-e937d04f568a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.703392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.703999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.704277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.704545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.729518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.737797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.738425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.738699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.738965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.739727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.739976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.741337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.749170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 333/671] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.749987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.780999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.782561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.799908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.850420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd94dd-0745-4076-a149-f1bdaa3f5ade None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.883488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.884073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 339/672] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:38.884198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.884387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.884629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.884896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.885380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.885689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.887245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.899717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 334/673] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.900570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.948224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.988041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2304-d720-49cc-bc04-966a69e70d88 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.996030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd989c4-c8a9-402a-868d-3d52ae3d844f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.004191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.022472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.023073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.023346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.023618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.024325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=f2440b4168f446639c4dd3761ea57438) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:39.024625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.026082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394d76-37e3-4b37-bb82-ee3e80dfd49a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.030241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64020465-5474-406a-addb-4edda726e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.030857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64020465-5474-406a-addb-4edda726e282 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.031135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64020465-5474-406a-addb-4edda726e282 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.031409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64020465-5474-406a-addb-4edda726e282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.031788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 340/674] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/role_assignments?user.id=f2440b4168f446639c4dd3761ea57438&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:39.032935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57244-68df-48d0-b171-029f3875753f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.033216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57244-68df-48d0-b171-029f3875753f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.033484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57244-68df-48d0-b171-029f3875753f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.034693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 341/675] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:39.035375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f57244-68df-48d0-b171-029f3875753f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.055561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64020465-5474-406a-addb-4edda726e282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.057358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64020465-5474-406a-addb-4edda726e282 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-64020465-5474-406a-addb-4edda726e282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:39.073889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:39.074927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:39.075843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:39.075843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:39.075843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:39.078114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 335/676] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:39.079470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64020465-5474-406a-addb-4edda726e282 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.157525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f57244-68df-48d0-b171-029f3875753f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.193487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64020465-5474-406a-addb-4edda726e282 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.195370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.198309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.198954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.199298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.199579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.211373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.212833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-75493257-adc0-4c31-a6fe-5c4f33e4fe19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:39.228689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:39.229725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:39.231112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:39.231112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:39.231112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:39.231112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 342/677] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:39.231112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.231395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.231706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.237388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.238170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.238566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.238845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.239648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=cba449ceaf8746779958a1278e6d4cc2) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:39.239957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.241392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.247720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 336/678] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/role_assignments?user.id=cba449ceaf8746779958a1278e6d4cc2&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:39.253904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.254096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:39.254096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:39.303235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.360731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 343/679] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:39.362466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.370825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e04f97-63cb-4c00-8312-f989d89fffd0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.460159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.460774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.461046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.461316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.463175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:39.463487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.464865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.479034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 337/680] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:39.483602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cb136-dc3a-43f0-b397-1273deddd759 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.483971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.516740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.524978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.525599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.525949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.526226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.526879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:39.527179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.528562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.541816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 344/681] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:39.559817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.588377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.603097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7bcf-6d93-445d-8923-09297ccb5db7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.640005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.640559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.640833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.641100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.649367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.651017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:39.663917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:39.664941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:39.665921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 338/682] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:39.668443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ce03a-c880-4536-ae5d-55a3a65aa6c9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.671616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.712166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.712689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.712908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.713141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.723137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.725003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:39.738179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:39.739152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:39.740619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:39.744525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 345/683] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:39.745413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.787049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.803938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efbce3-c7d5-4f26-b53a-5fb1d8674620 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.839308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.839914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.840186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.840452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.841174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:39.841601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.843184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.851925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.874752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 339/684] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:39.876172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.885637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f510bf-3809-4f8c-99bd-c2c7b8e8e685 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.938104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.938703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.938975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.939240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.951131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:39.956437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:39.957400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:39.958352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 346/685] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:39.959047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.014263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515586d5-529b-4813-a160-d3efac6f9c3b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.054515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.055463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.056217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.056705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.057611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:40.058138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.059778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.072797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 340/686] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:40.073945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.078251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d926a-1093-4dc3-a626-d19ebd626c42 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.083504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.113624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.113989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.114235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.114567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.131653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.197729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.198532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eeae5-0743-4a54-8ad6-341a67ac4845 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.199879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.244112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.244711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.244985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.245253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.245931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:40.246231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.248138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.259569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 341/687] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:40.260481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.321968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 347/688] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:40.321968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.342266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.379173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.382280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b05fc-3a82-4d30-980c-629454a4a714 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.417557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.418366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.418743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.419114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.419944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=f83352aa0c3843e09f2a666b753a7b4a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:40.420364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.422179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.433871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 342/689] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/role_assignments?user.id=f83352aa0c3843e09f2a666b753a7b4a&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:40.433871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.475190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecb213-ac80-45c3-9713-5c7564ee2cf0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.524094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.525097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.525596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.526102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.541734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.545686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:40.565981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:40.566982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:40.567930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:40.567930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:40.567930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:40.570211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 348/690] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:40.576211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.632439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abd08-d420-4de1-b559-bb4e346cd4a9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.694197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.704126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bac8f-1af6-46ab-af4d-1be4d2ab64f0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.705587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.715052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.715903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.716622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.717363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.732112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.734343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.741685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.742317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.742592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.742862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.743498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:40.743796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.745154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:40.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:40.755509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:40.756628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:40.756628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:40.756628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:40.759065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 343/691] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:40.761932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 349/692] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:40.764957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.765654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.878909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d723cc-17b3-4df1-9b5b-70acceef8235 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.895023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce035-d651-4a0b-b9aa-e218ac049c4c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.915609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.916305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.916580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.916899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.924271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.925721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.934477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.935384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.935890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.936372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.937235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:40.937914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:40.938594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:40.939604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:40.940671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 350/693] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:40.943328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.946528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.957407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 344/694] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:40.963671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.965124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.029065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.064611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8097e-9038-450d-989e-38e4ef07dab5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.101427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.102450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.102946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.103511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.104569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:41.105084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.106744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e50f01-33a0-4e68-a54f-869b80f8dc04 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.121715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffafd6-785b-4bd8-bd63-5a4afa94243d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.126845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 351/695] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:41.132619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ea89-f71b-45ba-aaef-849116938141 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.133269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ea89-f71b-45ba-aaef-849116938141 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.133746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ea89-f71b-45ba-aaef-849116938141 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.135569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 352/696] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:41.136435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ea89-f71b-45ba-aaef-849116938141 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.165886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.166898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.167176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.167465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.176285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.178481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-25c969b9-c2d4-43b6-a302-2fe7060a80ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:41.192255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:41.193418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:41.194431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 345/697] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:41.195055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.195505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.195784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.220990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:41.222479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:41.224503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.266684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ea89-f71b-45ba-aaef-849116938141 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.310552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 346/698] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:41.311643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.323898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.324745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.326881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.327311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.370199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.441235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.443185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.500079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505317-c9a9-4192-af54-1309c42f3c5b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.516058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.551081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 353/699] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:41.556984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.563521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.564315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.564704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.565087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.565934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:41.566351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.568482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.606946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 347/700] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:41.612477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.664173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311b0d-5ad5-48c8-a762-363ff43ce95a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.713509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.714235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.714511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.714779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.725332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.726825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.726962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.736861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8460-8223-4771-8c19-3b61c3aed9db None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-dfe2f198-f9d2-4022-9321-5988466e0cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:41.742020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:41.748144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 354/701] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefe2e-d473-457b-b499-e83ee8c64eb7 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefe2e-d473-457b-b499-e83ee8c64eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.749036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefe2e-d473-457b-b499-e83ee8c64eb7 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.750635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 355/702] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:41.751144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefe2e-d473-457b-b499-e83ee8c64eb7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.776135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.776737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.776928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.777048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.777280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.778038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=745d4cf142e24a7c9fb31af289f71fb6) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:41.778350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.779785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.786016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 348/703] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/role_assignments?user.id=745d4cf142e24a7c9fb31af289f71fb6&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:41.787034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.886990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefe2e-d473-457b-b499-e83ee8c64eb7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.925718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93331a8-ee75-46b8-b4f5-e1450a83f870 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.932374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.933050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.933330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.933625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.934347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.935890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9cceba1c-6606-47ac-afe1-64f61833b8c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:41.949613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:41.950792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:41.951645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 356/704] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:41.953025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.953025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.953206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.975981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:41.977421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:41.980528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.981389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.981939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.982457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.983382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:41.983906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.985626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.000076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 349/705] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.001222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.024845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.065803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 357/706] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:42.066511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.090068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.116241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f194-ab95-43ca-8011-5966a097b0bf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.151681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.152579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.153013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.153429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.154251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:42.154780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.156348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.162244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 350/707] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.168291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.193649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc510183-e2de-4b8e-9950-18e5e6f04f2d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.232681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.233321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.233602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.233894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.249534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.251035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:42.278318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:42.279329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:42.280281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:42.283582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 358/708] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:42.290881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.322282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.340825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba63c3-1a92-4010-9b7a-d7f5169279ce None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.377306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.378168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.378554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.378929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.379824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:42.380914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.382556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.391092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 351/709] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.392149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.409372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.434645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d83fa-c9c4-4518-8c3f-75db8a51e29b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.481584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.482259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.482539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.482866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.483526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:42.483839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.485308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.506853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 359/710] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.512777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.535108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ed58-1d93-4e11-8ffb-cbb6ce8355b5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.593645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.594819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.595301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.595771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.609217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.610813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.614634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:42.629569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:42.630748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:42.631662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:42.631662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:42.631662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:42.635800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 352/711] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:42.637298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.647727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e314e0-47d6-4152-98d3-6e71deb0c1f3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.738849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.739922 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.740203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.740474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.741210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=5d50090e8a924a76b634807f00734c39) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:42.741517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.742990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.756520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 360/712] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/role_assignments?user.id=5d50090e8a924a76b634807f00734c39&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.763837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e85d-5ec1-41ce-8c60-dfdf6419b496 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:42.801544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:42.802747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.803023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.803294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.803964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:42.804264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:42.805976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918790d0-a79d-49f1-aee6-c8b34300e875 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:42.823732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 353/713] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.825227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:42.828324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.879452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c493b0-4c99-4ba4-8733-3c0921935fcc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.879805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c493b0-4c99-4ba4-8733-3c0921935fcc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.880115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c493b0-4c99-4ba4-8733-3c0921935fcc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.881703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 354/714] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:42.887154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.887437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.887709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.910905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:42.913679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:42.980719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:42.987977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafacb9-1bae-43df-ad8b-eb9c41047de9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:43.005760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 355/715] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:43.047558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:43.048178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:43.048454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:43.048724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:43.049387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:43.051030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:43.091204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 361/716] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:42 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:43.284103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:43.398319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e3028-be8a-4fc3-93e3-283411491f24 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:43.433310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:43.433976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:43.434255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:43.434527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] PATH_INFO: `/v3/services/network` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:43.435109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:43.436481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:43.449129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:43.451478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:43.453288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 356/717] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:43 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:43.461928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:43.518212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:43.566383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f361c-231b-49d9-828f-afa8e1b9bce2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:43.604727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:43.605334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:43.605670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:43.605963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:43.606590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] RBAC: Adding query filter params (name=network) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:43.606885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:43.608251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8980ed1-c32d-4b31-ab3c-cc1414e18dfa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:43.613460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 362/718] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:06:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:43.618752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:43.672701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:43.727572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdb0e-c034-403e-8d73-1a3797f7ba56 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:43.762468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:43.763070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:43.763342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:43.763608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:43.764230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] RBAC: Adding query filter params (type=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:43.764529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:43.765942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c79882-8ae6-47fe-a16b-95c8ace13a3f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:43.771256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 357/719] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:06:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:44.267882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc572e6-9c17-4b48-abe2-495eb2e4a22e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.268552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc572e6-9c17-4b48-abe2-495eb2e4a22e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.268552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc572e6-9c17-4b48-abe2-495eb2e4a22e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.270055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 363/720] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:44.276165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783740ba-fa8d-4f85-9509-14efcceab94f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.276449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783740ba-fa8d-4f85-9509-14efcceab94f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.276772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783740ba-fa8d-4f85-9509-14efcceab94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.295702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-783740ba-fa8d-4f85-9509-14efcceab94f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:44.296894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-783740ba-fa8d-4f85-9509-14efcceab94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:44.376682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 358/721] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:44.668094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202ddb-0941-4f3c-a1ff-1ac517dd5af6 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.668452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202ddb-0941-4f3c-a1ff-1ac517dd5af6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.668645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202ddb-0941-4f3c-a1ff-1ac517dd5af6 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.670169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 364/722] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:44.675467 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.676000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.676000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.697410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:44.702688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:44.750619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:44.788421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 359/723] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:44.805947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202ddb-0941-4f3c-a1ff-1ac517dd5af6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:44.971765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202ddb-0941-4f3c-a1ff-1ac517dd5af6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.005238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.017624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.018563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.019052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.019547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.035326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:45.040965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:45.041973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:45.042841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:45.050597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 365/724] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:45.056562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.205677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b32b4-84d9-44bb-acab-71b325dd5265 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.252650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.254976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.255760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.256187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.256626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.257455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:45.257925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.259453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.273830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 360/725] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:45.278942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.351789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.365501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbaac-ffc4-496e-b7eb-0b8f36a4634b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.403562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfaa4d-113d-4df6-9fe4-7b55d9e9b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.404441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfaa4d-113d-4df6-9fe4-7b55d9e9b276 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.404888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfaa4d-113d-4df6-9fe4-7b55d9e9b276 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.405335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfaa4d-113d-4df6-9fe4-7b55d9e9b276 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.406260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfaa4d-113d-4df6-9fe4-7b55d9e9b276 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.407864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfaa4d-113d-4df6-9fe4-7b55d9e9b276 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.425803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c97c-209c-4b76-88be-b9015423f4f5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.430052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 366/726] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:06:45 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:06:45.438330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3006b-706f-4f90-b453-ff26ef5d2788 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.440522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3006b-706f-4f90-b453-ff26ef5d2788 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.441674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3006b-706f-4f90-b453-ff26ef5d2788 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.445349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 367/727] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:45.455549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753da1d-dc19-4e7c-bc79-08241d6d5262 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.456207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753da1d-dc19-4e7c-bc79-08241d6d5262 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.456699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753da1d-dc19-4e7c-bc79-08241d6d5262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.493893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0753da1d-dc19-4e7c-bc79-08241d6d5262 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:45.493893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0753da1d-dc19-4e7c-bc79-08241d6d5262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:45.497819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.498499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.498845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.499124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.511268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.512761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:45.530668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:45.531687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:45.532580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:45.532580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:45.532580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:45.532580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 361/728] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:45.539197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.590042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.653624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 368/729] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:45.655045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08cc1-dd0f-4242-8225-710e0aae8f63 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.655338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08cc1-dd0f-4242-8225-710e0aae8f63 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.655612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08cc1-dd0f-4242-8225-710e0aae8f63 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.657152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 369/730] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:45.662704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.662988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.663267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.670758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.685064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:45.686371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:45.699965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ce532-2442-40bc-bca6-4346342858e4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.745542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.746427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.746866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.747224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.747932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:45.748292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.750388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.765977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 362/731] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:45.772159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.779797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 370/732] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:45.890485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21adbe-b4d4-4962-9528-a61208a46734 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.930864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.931515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.931799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.932075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.947019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.948225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.948504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:45.962134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:45.963123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:45.964128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 363/733] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:45.977402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.983960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.099808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69408bf3-7323-454d-816c-2bca4cc0c326 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.101801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.126511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299c23-e9c6-49c9-a7c9-a794e8517f4b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.147936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.148588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.149423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.149706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.164049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:46.164230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8459499-046e-4713-b620-50393826b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.164773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459499-046e-4713-b620-50393826b819 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.165055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459499-046e-4713-b620-50393826b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.165325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459499-046e-4713-b620-50393826b819 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.166099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459499-046e-4713-b620-50393826b819 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:46.166406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459499-046e-4713-b620-50393826b819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.167850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459499-046e-4713-b620-50393826b819 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:46.168993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.169939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:46.170805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:46.171896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 371/734] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.176546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.193061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 364/735] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:46.194297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8459499-046e-4713-b620-50393826b819 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.276077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.280459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fc8b7-6721-4fa0-80e0-455e1df6f3d2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.320904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.321915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.322149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.322421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.325240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8459499-046e-4713-b620-50393826b819 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.335874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:46.342876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.344024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:46.345079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:46.349981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 372/736] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.351105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.382644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.383500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.383953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.384381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.385648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:46.386144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.387956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.388347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.400995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 365/737] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:46.402397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.489021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab0b8-9bd6-4108-9da8-d17e58835343 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.526395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44717579-56b6-4263-a9e2-c23679dc8112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.527004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717579-56b6-4263-a9e2-c23679dc8112 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.527283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717579-56b6-4263-a9e2-c23679dc8112 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.527559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717579-56b6-4263-a9e2-c23679dc8112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.528926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe32f9-73fb-45ae-b128-eeb50e9f259c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.557995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.577456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.578149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.578431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.578715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.579378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:46.579685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.581059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.589912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 366/738] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:46.590713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.612105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44717579-56b6-4263-a9e2-c23679dc8112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.613731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44717579-56b6-4263-a9e2-c23679dc8112 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.641478 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.697637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9fa4a-2ab5-42f4-ad59-3384069f89ef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.724634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 373/739] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:46.725904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762751f-c554-4e56-8fa8-6f021d6fd306 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.726192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762751f-c554-4e56-8fa8-6f021d6fd306 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.726461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762751f-c554-4e56-8fa8-6f021d6fd306 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.727873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 374/740] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:46.728375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762751f-c554-4e56-8fa8-6f021d6fd306 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.740861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.741839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.742143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.742417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.753654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.755681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:46.770608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.771570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:46.777682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:46.777682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:46.777682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:46.777682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 367/741] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.777682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.820883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.837434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762751f-c554-4e56-8fa8-6f021d6fd306 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.869090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.882620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.883258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.883639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.883817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.888343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc81d0-ca62-42b9-8447-edb86ec13500 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.897563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.899081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d1894e76-67d3-476b-856a-acb572080d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:46.915662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.916731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:46.917645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:46.917645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:46.917645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:46.917645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 375/742] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.918370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.918705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.919056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.935178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.935814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.936095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.936374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.939195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:46.940434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:46.947871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.949979 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:46.963963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.964926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:46.965828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:46.965828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:46.965828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:46.969630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 368/743] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.970486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.021869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 376/744] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:47.021869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.077320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.090620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593376-c0a6-4e2d-8a21-1a4e110c9069 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.134785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.135602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.135878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.136412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.137057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.137359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.138865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.138975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11787657-bedb-4b32-be07-1eb6b38f342b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.141341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.158779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 369/745] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.158779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.186162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.187205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.187486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.187756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.188660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.188969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.190621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.205086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 377/746] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.206004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.273976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ecb41-98da-4c8f-8916-f3828bae8218 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.311798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.312708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.313006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.313361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.314032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.314356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.315733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.327194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 370/747] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.328002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.341168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.344500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc6d1-4bd7-4f35-a872-fd256c640c7c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.382001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.382548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.382844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.383168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.391338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.392711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:47.403852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:47.404820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 378/748] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:47.410602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.434673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.438930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435cb80-0aff-4d73-8745-8c03eff64179 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.473292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.474492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.474750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.475020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.483839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.485287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:47.497438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:47.498487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:47.499483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 371/749] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:47.503805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.517702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0570e-1b9b-4e38-b917-41bb15a6ab08 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.557538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.558170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.558509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.558786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.559431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.560790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.575691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 379/750] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:06:47 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:47.577559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.589061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.619038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182800-62ad-49e5-831d-7e248ab8ce07 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.665703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.666681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.666963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.667237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.676175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.678248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:47.691921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:47.692924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 372/751] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:47.694468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.712948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.734605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39309-6094-4317-afa3-7e4731591862 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.777785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.778441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.778711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.778994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.779714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.780017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.781448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.799805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 380/752] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.800965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.821815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e859ed-ede8-4438-b84f-ad35b13846c0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.850500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.861345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.862101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.862380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.862767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.866382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.866698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.868319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588a0c6-5fdf-4fb9-903e-30e72b3ab6e4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.887288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 373/753] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.888520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220564b-790e-48ac-b669-68bd0a68653b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.888808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220564b-790e-48ac-b669-68bd0a68653b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.889083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220564b-790e-48ac-b669-68bd0a68653b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.890503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 374/754] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:47.890999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220564b-790e-48ac-b669-68bd0a68653b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.916834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9226c1-9831-4a7b-a049-72d331d688a8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.953966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.954573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.954847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.955114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.955805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.956104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.957539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255dee-a6af-4aa6-8978-5f5bba0449ae None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.970349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 381/755] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.971681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.972033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.972367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.979397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.992321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:47.993626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:48.017859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220564b-790e-48ac-b669-68bd0a68653b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.054201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.055160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.055974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.056249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.069881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 382/756] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:48.069881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.079111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.081611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:48.101210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:48.102435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:48.103523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:48.103523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:48.103523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:48.105486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 375/757] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:48.105486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.142297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.189056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf313-e0a2-4e73-b03e-e516c7fe721a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.207553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33b43-95ce-44ad-be0c-8f327db00dcb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.227511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.235370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.236416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.236845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.237262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.244293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.245017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.245404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.245773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.246613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=745d4cf142e24a7c9fb31af289f71fb6) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:48.247011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.248995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.257996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 376/758] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/role_assignments?user.id=745d4cf142e24a7c9fb31af289f71fb6&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.259028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.363591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.365719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.400225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.404030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c56642-3fcf-4466-9a0e-275c23c128f6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.443776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.444747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.445297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.445771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.446691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:48.447611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.448556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.462569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 377/759] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.463320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.490250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 383/760] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:06:48.491958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.532126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.583270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9abc2-ba27-49c9-aff9-572f5c01b546 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.594766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f285-5d7a-4cca-a792-7d9a8ada9f5f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.619919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.620700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.620981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.621552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.622168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.623552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:48.635301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:48.636523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:48.637539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 378/761] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:48.638535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.650620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.651482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.651936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.652848 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.662982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.665224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.672025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:48.686752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:48.687882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:48.689335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:48.697957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 384/762] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:48.697957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.772282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c2d87-6b01-409a-8959-02c31fab50f6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.802926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.816439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.817650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.818373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.818804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4a35-879d-4dd5-9069-236010df9caf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.819773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.832476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.835213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:48.867817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:48.868703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:48.869580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:48.869580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:48.869580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:48.874118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 379/763] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:48.875100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.892124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.892763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.893043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.893318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.894109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:48.894309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.896168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.901649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 385/764] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.905878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.051069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b76c7-2a59-4ece-b265-486f833c3cd9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.057073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.105349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c1ce1-fa8b-4fa1-86cc-75e77f666ef8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.109972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340109a0-4049-422a-a431-75691bad1878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.110450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340109a0-4049-422a-a431-75691bad1878 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.110796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340109a0-4049-422a-a431-75691bad1878 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.111068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340109a0-4049-422a-a431-75691bad1878 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.111714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340109a0-4049-422a-a431-75691bad1878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.112013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340109a0-4049-422a-a431-75691bad1878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.113405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340109a0-4049-422a-a431-75691bad1878 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.149173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 386/765] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.149940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340109a0-4049-422a-a431-75691bad1878 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.168877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.169866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.170345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.170914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.171388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.172911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.173424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.175283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.214184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 380/766] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.215412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.302897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340109a0-4049-422a-a431-75691bad1878 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.354594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa7d3a-3c8f-42b2-bb79-f0af81954a51 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.373140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.375009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.375296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.375570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.376206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.378862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.384809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.398126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 387/767] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.399068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.409124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.410100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.410576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.411092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.414100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.420560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.422430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:49.435096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:49.436043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:49.436921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:49.439297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 381/768] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:49.445313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.488558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.511404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe690-51b4-4356-a7d9-e1467e5c5b7e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.547231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.547892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.548176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.548631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/5d50090e8a924a76b634807f00734c39/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.550452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=5d50090e8a924a76b634807f00734c39, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.552394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7433c3-7466-4453-8d1f-a266cb853a87 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.552509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.573958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 388/769] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:49 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/5d50090e8a924a76b634807f00734c39/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:49.573958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.606541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.607890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.608195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.608621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.609485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] RBAC: Adding query filter params (interface=public, service_id=b0e48eb1459f48b9b8a217e0f9b20f68, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.609805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.611596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f9dce-7d45-4d6c-a7fd-6799072fba81 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.623073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 382/770] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/endpoints?service_id=b0e48eb1459f48b9b8a217e0f9b20f68&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.624354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae103e3-f7b7-4fde-a876-b9c3fdc30058 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.624645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae103e3-f7b7-4fde-a876-b9c3fdc30058 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.624923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae103e3-f7b7-4fde-a876-b9c3fdc30058 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.630367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 383/771] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:49.633094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae103e3-f7b7-4fde-a876-b9c3fdc30058 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.711641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.718976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21483-a175-478f-bab4-bd4dfeec28b1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.762078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae103e3-f7b7-4fde-a876-b9c3fdc30058 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.775149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.775768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.776049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.776319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.777022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.777325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.778803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0e2be-f088-4588-b10d-625769d11f12 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.788901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.792827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 389/772] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.794129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.794418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.794693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.808679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.809205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.810127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.810440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.811052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.812441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.818132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 384/773] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.818934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.819508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:49.820772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:49.939803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 390/774] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:50.000772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0127ad-aa8c-41fd-9bdc-fb53ef522a2b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.036675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:50.048422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.049373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.049900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.050427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.051364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=7f37e7598e29465ab6182da7ee0e4e2d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:50.052402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.054166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd107-9a5c-4d0c-a6ee-71d6d7992c6c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.064643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 385/775] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/role_assignments?user.id=7f37e7598e29465ab6182da7ee0e4e2d&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:50.235846 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.344011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34510d6-ec4f-4cab-92a1-394498ebf528 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.344385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb43e8e-8240-4a3c-bb4a-ea1eb389e4d3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.344653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb43e8e-8240-4a3c-bb4a-ea1eb389e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.344924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb43e8e-8240-4a3c-bb4a-ea1eb389e4d3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.347501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 386/776] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:50.351560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.351841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.352117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.370473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:50.371654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:50.375824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:50.393040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.393682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.393979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.394249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.394829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.396366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:50.418159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:50.419180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:50.420021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 391/777] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:50.430100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.504115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 387/778] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:50.584728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1edc7-73a7-4f4f-a255-49bb6fe5c2a8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.631249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.631856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.632132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.632401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.633029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:50.633326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.634719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.641500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 392/779] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:50.647364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.806898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05c353-bdc8-4d07-9a09-4d53fab591e9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.834668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:50.855404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.856018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.856300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.856574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.857209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] RBAC: Adding query filter params (type=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:50.857515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.858144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.858919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.867415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 388/780] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:50.874897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.970156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.045668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1481-d9d0-4e35-9c9e-f4f3a8203c7d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.049098 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc07f-3595-4596-aef7-60aa1ce105b4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.113474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.113474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.113749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.114015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.114692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] RBAC: Adding query filter params (interface=public, service_id=f833034985094426801830a77c0e890a, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:51.115006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.115943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.116565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.116837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.117105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.121294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.129268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 389/781] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/endpoints?service_id=f833034985094426801830a77c0e890a&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.135781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.142850 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:51.148731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:51.149685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:51.150555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:51.158303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 393/782] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:51.166770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.202209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.246866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083690c4-9715-474e-ad55-6701be05ccc9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.287012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.287623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.287908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.288178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.288782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.290191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.296677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 390/783] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.372140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f572-cc10-4e72-873c-47e582fef154 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.391324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.417827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.418494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.418772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.419042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.419731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:51.420025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.421429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.432575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 394/784] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.437464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.583178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57fb39-f03c-4f71-acf5-c8a8054d7823 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.596410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.622624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.623765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.624048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.624326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.636956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.638624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7cd07861-e409-4cd4-882c-0f337fb68b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:51.654610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:51.655599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:51.656501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:51.656501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:51.656501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:51.659083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 391/785] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:51.664950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.696155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a25d-452c-40e3-8df1-a2bb56da461e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.696470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a25d-452c-40e3-8df1-a2bb56da461e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.696709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913a25d-452c-40e3-8df1-a2bb56da461e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.698373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 392/786] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:51.715782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.716154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.716387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.748447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:51.749682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:51.823554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 393/787] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:51.851149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e91e-7e18-474f-85da-9362b3d16a63 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.900838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.901375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.901656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.902176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.902832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:51.903136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.904510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.921369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 395/788] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.927107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.026129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.035108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775dfe5-f7fb-4f83-9e50-99b88a701836 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.071977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.072592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.072871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.073200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.080602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.082205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8ede0f8e-49c2-421d-901e-dd5c4e11d870 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:52.094227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:52.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:52.096195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 394/789] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:52.102953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.159943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.238067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f368a-0aba-439e-a6df-c74f73522710 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.265161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b8487-16c2-44cf-be24-35f7d69d5272 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.265465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b8487-16c2-44cf-be24-35f7d69d5272 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.265708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b8487-16c2-44cf-be24-35f7d69d5272 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.268380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 395/790] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:52.272949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.273229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.273502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.288512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.289126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.289405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.289679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.290459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:52.290758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.291737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:52.292244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.292925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:52.322190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 396/791] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.330936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.399476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 396/792] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:52.400522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.469477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.475694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72afa1-9844-4146-b653-d16fa75efad4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.510762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.533164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe88a-3a1e-4aad-8684-9db1018b9937 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.555095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.555993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.556270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.556540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.576397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.577793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.578498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.578778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.579052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.580311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.595890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b001f98b-d871-461b-87cd-5f1216c7fa52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:52.598397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:52.599323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:52.600253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:52.600253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:52.600253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:52.600253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 397/793] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:52.600876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:52.602933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:52.604960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:52.606750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308df6-2b16-449c-9a87-d89df81f38a6 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.606750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308df6-2b16-449c-9a87-d89df81f38a6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.606750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308df6-2b16-449c-9a87-d89df81f38a6 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.606750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 398/794] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:52.607310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 397/795] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:52.610732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308df6-2b16-449c-9a87-d89df81f38a6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.610917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.723193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea632-f54d-4d73-a221-07b35c96556c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.734968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308df6-2b16-449c-9a87-d89df81f38a6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.762683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.763517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.763937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.764340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.765165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:52.765598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.767143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed3224-60a4-4d37-aca8-208025b76ef7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.771351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.771956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.772229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.772504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.773130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:52.773428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.774861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.781056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 398/796] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.787934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.790319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.790875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.792870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 399/797] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.798167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.798630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.811472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.811618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:52.812692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:52.881761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 399/798] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:52.891081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.912446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc860f8d-a1ea-4792-b672-53301188d2d1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.948321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.949369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.949510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.949788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.961657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:52.967049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:52.967987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:52.968851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:52.973107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 400/799] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:52.974245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.022819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524039c-5d77-4d56-b1c8-c4946051ed12 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.059221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.059949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.060122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.060447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.061172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.063639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.075868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.077588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:53.093492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:53.094625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:53.095533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:53.095533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:53.095533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:53.095533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 400/800] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:53.096741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.100566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf9596-13d1-40b0-a475-d18ccc3fb2cd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.142200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.142911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.143256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.143589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.151324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.152787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:53.164866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:53.165765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 401/801] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:53.167053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.215019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b8b0c-4368-4ebf-a7c0-68e4276aefb1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.249933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.250540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.250820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.251094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.251753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:53.252057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.253430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.262578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 401/802] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:53.263223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.280883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4afc-352b-4c52-936c-a3933c6fe2e2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.310480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.317930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.318531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.318809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.319276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.319717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:53.319969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.320088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.321371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.337092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 402/803] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:53.337092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.381889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d17bb-ec55-4ae8-b42c-e7cf4ec7c0ae None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.419363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.419983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.420566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.420838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.421560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.422980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:53.432006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:53.432990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:53.433827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 402/804] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:53.434683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.446254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e3a9a-3850-40be-b82b-49f7a6c5c1fb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.480692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.481291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.481565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.481832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.482544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:53.482843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.484267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.496207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 403/805] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:53.496914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.547449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8f6bf-0e22-4ea5-a8ac-cdcf43c438da None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.554458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.562069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.585740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.586398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.586798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.587217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.599302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.600893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.605117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574b711-3a83-40eb-9207-55b051183e2f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:53.616762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:53.618066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:53.619318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:53.619318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:53.619318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:53.619318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 403/806] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:53.619318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.647470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.648091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.648363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.648627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.655440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.656927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:53.668589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:53.669600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 404/807] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:53.670690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.717932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76488a83-455d-4d6c-bd22-1d26bbd8be50 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.751868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.752466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.752750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.753023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.753649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:53.753991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.755417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.759811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 404/808] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:53.760574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.771151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751319-16f8-4693-8716-63b08d6a4a75 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.781298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.788912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.806840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc68fbd-e85f-4764-bc21-c2aa3e7c3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.807424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc68fbd-e85f-4764-bc21-c2aa3e7c3645 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.807696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc68fbd-e85f-4764-bc21-c2aa3e7c3645 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.807968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc68fbd-e85f-4764-bc21-c2aa3e7c3645 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/745d4cf142e24a7c9fb31af289f71fb6/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.809813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc68fbd-e85f-4764-bc21-c2aa3e7c3645 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=745d4cf142e24a7c9fb31af289f71fb6, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.811270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc68fbd-e85f-4764-bc21-c2aa3e7c3645 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.823883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 405/809] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:53 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/745d4cf142e24a7c9fb31af289f71fb6/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:53.827135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cc46-b11b-4e46-893d-35fbe97b8e9f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.827424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cc46-b11b-4e46-893d-35fbe97b8e9f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.827732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cc46-b11b-4e46-893d-35fbe97b8e9f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.829069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 406/810] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:53.829802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427cc46-b11b-4e46-893d-35fbe97b8e9f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.878303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319382-f7df-4570-ae35-6fcb01947bbe None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.918222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.919415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.919415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.919415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.920020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:53.920328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.921725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.941170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 405/811] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:53.942231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.954359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427cc46-b11b-4e46-893d-35fbe97b8e9f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.998578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.999199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.999451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.999719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.000442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:54.000741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.002228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276cae8-6b87-430f-8739-f62047275695 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.021993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 407/812] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:54.025896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.025896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.025896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.038985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.042719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:54.043886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:54.052248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a0f5d-f8ab-469c-b935-50015ecb6073 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.069955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.089610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.090815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.091089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.091363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.091993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:54.092289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.093640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.098738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 406/813] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:54.099573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.130013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 408/814] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:54.133197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.199601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10ae30-668e-4c20-8d38-66f7bb147129 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.234462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.235252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.235624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.235994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.239585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f1d7-9ccd-42be-a99a-c861a2fdd670 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.243886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.245452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:54.258119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:54.259290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:06:54.260475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:54.262257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 407/815] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:54.263576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.278208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.278770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.279540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.279951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.280219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.311503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.362630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.365488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.367941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bdb36-3612-4059-ac3a-737f8e7824ac None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.403583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.405000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.405000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.405000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.406078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.407531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.433993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 408/816] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:06:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:54.433993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.482684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 409/817] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:06:54.482684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.543742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.566279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.570586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32126-fa6d-45b6-9212-c12d68ef3402 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.595672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26a9a-4550-46c8-a226-e478ba886733 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.620361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.620900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.621180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.621453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.622262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:54.622567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.624126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.636055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.636701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.636976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.637247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.637862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.639230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.643638 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 409/818] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:54.644689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:54.649578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:54.650613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:54.652096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 410/819] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:54.653050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.759237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b46763-8062-4a1e-a9ee-bf784b94bae2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.771225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b78a26-b886-4f6d-a9d4-7d65d25957d8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.785043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.799572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.800180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.800822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.801114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.801392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.813538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.813784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.814506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.814847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.815050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.815251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:54.830803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:54.833309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:54.834845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:54.834845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:54.834845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:54.834845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 410/820] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:54.834845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.959083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb443e5-6620-42fb-89e5-0efc578787ce None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.962229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.963703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:54.981718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:54.982705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:54.983584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:54.983584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:54.983584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:54.986004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 411/821] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:54.986920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.003738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.005015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.005393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.006101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.006532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] RBAC: Adding query filter params (name=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.006930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.008393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.013441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 411/822] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.014593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.062280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.097773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87601-4445-4139-9f0c-a22282005e6d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.133744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3389-a0a5-40df-828d-725907228b53 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.147021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.147876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.148305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.148791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.149668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.150198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.151935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.169069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 412/823] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.169823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.173669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.175156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.175461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.175737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.176950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.177255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.178652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.197535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 412/824] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.198476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.210104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.281594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b43071-5bf0-4228-92df-3d8ffa658cab None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.298166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.302540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9515195-0d2d-431e-8535-c0dfed393c1c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.319416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.320151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.320461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.320810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.321508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] RBAC: Adding query filter params (type=network) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.321907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.323423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.328827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 413/825] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.329714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.342181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.343086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.343544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.343993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.351742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.353419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.445831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.450599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0a61-ef3f-4997-a473-9eaf9cabc79b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:55.484839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:55.485819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:55.486754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:55.488875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 413/826] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:55.489825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.495859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.496505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.496786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.497106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.504953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.506473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:55.518294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:55.519225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:55.520781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:55.524763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 414/827] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:55.525644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.604590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e74be-4eb0-4751-b8aa-f7a7915e7ba9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.635235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ffa8c-7d77-4ac1-a4f7-72c38a3324b9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.642731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.643605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.644121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.644602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.646084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.647647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.670759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 414/828] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:06:55 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:55.672053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.682288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.683298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.683413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.683651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.684455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.684766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.686586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.692484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.702531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 415/829] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.709284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.728643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.790363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773efe-7edd-4f71-a706-3d4906a53912 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.831277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.832056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.832474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.833453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.834288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.834689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.836237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820c1a4-ec8f-42fc-9e83-eb320c18bbee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.846529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a387-30a4-4825-a9a5-a045f7a388d7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.854285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 415/830] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.854285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9c967-f6b5-4de0-aa70-0033a67c06da None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.854285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9c967-f6b5-4de0-aa70-0033a67c06da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.854285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9c967-f6b5-4de0-aa70-0033a67c06da None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.854285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 416/831] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:55.863342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9c967-f6b5-4de0-aa70-0033a67c06da None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.900310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.901228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.901742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.902275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.903184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=5d50090e8a924a76b634807f00734c39) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.903509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.905784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab818ce-788a-433c-8a13-cc7648fdf31a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.916313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 416/832] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/role_assignments?user.id=5d50090e8a924a76b634807f00734c39&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.919034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.919525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.919992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.943759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:55.946004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:55.978225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.001711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9c967-f6b5-4de0-aa70-0033a67c06da None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.044170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 417/833] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:56.065651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.066417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.066740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.067059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/7f37e7598e29465ab6182da7ee0e4e2d/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.089816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=7f37e7598e29465ab6182da7ee0e4e2d, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.091358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.104256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 417/834] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:55 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/7f37e7598e29465ab6182da7ee0e4e2d/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:56.325533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.336619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.429962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8d1b0-440f-4d2a-b6a0-49467a34a67e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.464716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3036b-f1d0-4cd6-9c08-bca998025afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.465585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3036b-f1d0-4cd6-9c08-bca998025afa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.466058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3036b-f1d0-4cd6-9c08-bca998025afa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.466465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3036b-f1d0-4cd6-9c08-bca998025afa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.477527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3036b-f1d0-4cd6-9c08-bca998025afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-cbe3036b-f1d0-4cd6-9c08-bca998025afa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:56.482458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:56.483554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:56.484566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:56.491933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 418/835] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:56.493443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.531178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f1a1-0009-4651-a2c4-f0609526033b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.531684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f1a1-0009-4651-a2c4-f0609526033b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.532094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f1a1-0009-4651-a2c4-f0609526033b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.534521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 419/836] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:56.539295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.539676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.540068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.569043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:56.570439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:56.620681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7676-b52c-45ac-b35a-77964b0ae74d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.638502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.650199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 420/837] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:56.654173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.666389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.667280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.667730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.668172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.669002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:56.669474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.671043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.684635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 418/838] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:56.686190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.787144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3540b8-f9d5-4fb2-88bd-15895c2fba86 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.822325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.823227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.823678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.824118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.834804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.836417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:56.851117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:56.852424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:56.853319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:56.853319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:56.853319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:56.859490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 421/839] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:56.861013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.920913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.975138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe56bb-b5a8-4902-886c-d8024f4d1b53 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.982099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.021997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.022718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.023252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.023521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.024539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.024838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.026344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.040568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8c692-01be-4d70-ad88-8b1c6b09181b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.045930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 419/840] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.049150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.087266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.088409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.089728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.090234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.091006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.092565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.101075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:57.104642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:57.105645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:06:57.106536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:57.108055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 422/841] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:57.112650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.179801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5c852-3415-4c23-b34b-c55b396d187b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.219998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.220960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.221430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.221958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.224152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd347a-d18d-4a28-9340-cc768c6bcd61 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.230350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.232131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:57.246968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:57.247983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:06:57.248918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:57.250258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.251933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 420/842] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:57.259328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.270535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.271342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.271794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.272193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.272955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.273391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.274912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.280131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 423/843] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:57.285879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.362600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02eefa-af6b-4677-a89f-ce17cba26774 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.369455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.396832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25179c-6cf7-4101-bfc0-418de44ca3d9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.398277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.399034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.399328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.399686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.401112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.401112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.402396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.424672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 421/844] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.425977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.435052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.435901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.436354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.436800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.437637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.438186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.439816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.449963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 424/845] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.536397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0599-2dc0-4f67-9a6b-ffeb6a3b3472 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.573476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.574122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.574397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.574664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.607725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.646265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.647720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.752304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 422/846] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:06:57.753799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.799682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.867777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3ac9-9ebf-4da4-86a8-c075f911cb22 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.904716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.905349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.905629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.905940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.917738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.919356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-32db9dca-8002-4164-9869-ddf84a762fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:57.934642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:57.935598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:57.936487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:57.936487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:57.936487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:57.936487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 425/847] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:57.941505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.004170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.015460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808ebd-57fd-4cf5-be55-69277b8ae4c1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.016035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808ebd-57fd-4cf5-be55-69277b8ae4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.016500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808ebd-57fd-4cf5-be55-69277b8ae4c1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.018312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 426/848] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:58.024029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32438b36-bb3f-4e60-9ca5-e38aaae8fecb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.024561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32438b36-bb3f-4e60-9ca5-e38aaae8fecb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.025042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32438b36-bb3f-4e60-9ca5-e38aaae8fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.043587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-32438b36-bb3f-4e60-9ca5-e38aaae8fecb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:58.044121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1afb-44ba-4cfc-80e8-e28ead68f9aa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.045297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-32438b36-bb3f-4e60-9ca5-e38aaae8fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:58.078922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.079517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.079787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.080310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.080776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:58.081074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.082602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60344246-8a4f-47a9-8f7d-ba5a885c0d9c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.096985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 423/849] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.101013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d4e3-afe5-48b3-b0ad-4238e6dd985c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.101301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d4e3-afe5-48b3-b0ad-4238e6dd985c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.101577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d4e3-afe5-48b3-b0ad-4238e6dd985c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.103127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 424/850] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:58.103617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d4e3-afe5-48b3-b0ad-4238e6dd985c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.128494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 427/851] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:58.130502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.130784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.131049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.150064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:58.151400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:58.170235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.212130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d4e3-afe5-48b3-b0ad-4238e6dd985c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.234196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 428/852] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:06:58.242236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.248834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.249739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.250444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.251002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.258898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.260634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:06:58.272454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:58.273368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:06:58.274309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:58.276829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 425/853] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:58.282459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.384678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362067a-a05a-44bb-bcdb-29415a120dc9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.419155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.421258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.421879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.422161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.422431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.423119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:58.423418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.424838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.439525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 429/854] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.443057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.461226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.540687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0103a-67b6-4fae-bab5-7bd98de7599c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.551724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450b70-5578-4665-a078-4752169b4d8a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.576355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.577330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.577607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.577911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.578497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.579907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.589103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:58.589363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:58.591028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:58.592928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 426/855] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:58.595270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.595419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.595419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.595990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.596757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=745d4cf142e24a7c9fb31af289f71fb6) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:58.597062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.598567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.614109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 430/856] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/role_assignments?user.id=745d4cf142e24a7c9fb31af289f71fb6&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.614109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.660989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.707309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.717023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3552-ab67-4b84-ace3-7ac94b24d2b8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.733863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e7fa-7559-4790-9de9-0709b3ad0ea6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.755004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.755631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.755906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.756171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.771619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:58.775860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.775860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.775860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.775860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.776313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:58.776409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:58.777259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:06:58.782080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:06:58.782824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.782824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.782962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 427/857] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:58.783117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 431/858] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.787707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.789427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.900679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933edc4-41a7-4729-86dc-e3f198501992 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.918563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73683f-52b7-4d02-9d69-9bb938a7a3d9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.931259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.938708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.939531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.940003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.940511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.941371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:58.941836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.943385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.948874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 432/859] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.964044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.964721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.965002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.965271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.965992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:58.966300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.967801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.978742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 428/860] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.984781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.995700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.099956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c3aa-18c8-46cf-b7cb-f3524c1ad07c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.135630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.136187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.136467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.136741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.148172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.149631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:59.164457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:59.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:59.166798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:59.166798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:59.166798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:59.166798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 433/861] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:59.173158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.276210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304283c3-a09c-4be9-b7f7-72b610b19c7a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.313607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.314580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.315082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.315543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.316447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.317548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.319129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11cd7-6a7b-472e-9cdd-12ddf30d07d9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.335458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 429/862] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.338127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.399761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.434458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9bf6f-1ac0-4fa1-b893-b731b880abfa None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.434808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9bf6f-1ac0-4fa1-b893-b731b880abfa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.434990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9bf6f-1ac0-4fa1-b893-b731b880abfa None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.436549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 430/863] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:59.441291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.441569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.441896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.453773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23094fe2-74f7-49c1-9d96-b20d8e79ab10 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.464928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:59.466667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:59.493387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.494820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.495508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.495941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.498000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.508201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.509643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:06:59.522002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:59.522996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:06:59.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:06:59.527863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 434/864] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:59.528796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.559249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 431/865] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:06:59.637400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7f31-8fe4-4b7d-a8c9-c1ad88c68e4c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.655560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.673505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.674424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.674898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.675388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.676327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.676827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.678494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.697094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 435/866] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.703288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.808097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355315f-d4d6-4239-a59f-b0100c5b695a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.845654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.847833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.848491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.848765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.849021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.881297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.930665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.932523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.966037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507019c8-9863-46ed-82ad-8ba8c66a6cfa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.002048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.002869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.003245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.003615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.005010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.006588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.023068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 436/867] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:06:59 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:00.056432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 432/868] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:00.062116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.104910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.189272 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8f77-f148-4862-8d9a-9cd6949d9f8f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.225136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.225817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.226116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.226383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.237252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.239361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:00.254257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:00.255215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:00.256118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:00.256118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:00.256118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:00.256118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 437/869] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:00.261035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.325034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.366548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894e4f3-773a-4dcc-96f9-9623c18fc410 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.402211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.402860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.403139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.403406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.404045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:00.404342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.405699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.417753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 433/870] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:00.423013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.513076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.529567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959586cb-06f2-405f-a7ca-ea537f2c0a60 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.563423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.564045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.564319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.564586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.572032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.573479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a72ec74b-1537-498d-912d-06ef81979b5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:00.584668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:00.585549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:00.586473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 438/871] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:00.592684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.661656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d15ce6-e9e1-47fa-8a8e-2926e78585ed None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.662015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d15ce6-e9e1-47fa-8a8e-2926e78585ed None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.662218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d15ce6-e9e1-47fa-8a8e-2926e78585ed None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.663858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 439/872] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:00.668904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfff8d-8721-47b3-a98b-0cbffffb9c2c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.669182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfff8d-8721-47b3-a98b-0cbffffb9c2c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.669485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfff8d-8721-47b3-a98b-0cbffffb9c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.688639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-25bfff8d-8721-47b3-a98b-0cbffffb9c2c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:00.689947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-25bfff8d-8721-47b3-a98b-0cbffffb9c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:00.701319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b32a4a-8026-42b7-916a-ea81a4ea601c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.721651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.736353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.737263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.737859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.738141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.738847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:00.739147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.740689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.753660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 434/873] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:00.759144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.770436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 440/874] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:00.861221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818ff1-2bd0-4164-8584-99aee1306d39 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.896048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.896693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.896969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.897233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.897978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=7f37e7598e29465ab6182da7ee0e4e2d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:00.898283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.899709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d107-c5a8-49f6-8ca8-eee9b7ca4045 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.905962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 435/875] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/role_assignments?user.id=7f37e7598e29465ab6182da7ee0e4e2d&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:01.000587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de74ba-f51e-452d-898e-e373628a6df6 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.001107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de74ba-f51e-452d-898e-e373628a6df6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.001107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de74ba-f51e-452d-898e-e373628a6df6 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.003256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 441/876] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:01.008924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.009229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.009524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.029386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:01.030537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:01.057550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de74ba-f51e-452d-898e-e373628a6df6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:01.075249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:01.112565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 436/877] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:01.153527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:01.182036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de74ba-f51e-452d-898e-e373628a6df6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:01.217893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:01.218909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.219424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.219893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.220731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:01.222480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:01.231867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:01.232845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:01.233669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:01.236472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 442/878] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:01.243034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:01.356250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535f6a-a783-4fda-988f-0087a32a696d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:01.386704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:01.394134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:01.395259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.395543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.395813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.396451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:01.396749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:01.398195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:01.405943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 437/879] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:01.408697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:01.450503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:01.514526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ed4b-8792-4d8c-85e8-739db3ccf913 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:01.519503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271055bf-7595-4c2f-9651-487ff9ca7726 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:01.552626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:01.553587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.554106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.554600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.555691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:01.556188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:01.557743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0adeb-44ea-4b5a-9b04-ecb9ed0149b1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:01.563032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 438/880] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:01.563704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d6e53-cb52-4072-98e2-16379cc964a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:01.564304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6e53-cb52-4072-98e2-16379cc964a6 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.564577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6e53-cb52-4072-98e2-16379cc964a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.564843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6e53-cb52-4072-98e2-16379cc964a6 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.565492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6e53-cb52-4072-98e2-16379cc964a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:01.567701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6e53-cb52-4072-98e2-16379cc964a6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:01.588702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:01.591218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 443/881] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:01 2022] POST /identity/v3/services => generated 269 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:02.126930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75488e-ac43-4418-8240-14293384be77 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.127417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75488e-ac43-4418-8240-14293384be77 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.127417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75488e-ac43-4418-8240-14293384be77 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.128959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 439/882] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:02.134139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.134543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.134713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.154644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:02.155825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:02.236237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 444/883] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:02.499672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75488e-ac43-4418-8240-14293384be77 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:02.603989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75488e-ac43-4418-8240-14293384be77 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:02.605581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:02.640138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:02.640765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.641036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.641300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.641888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:02.643245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:02.652886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:02.653975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:02.654807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 440/884] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:02.660146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:02.769097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0671c-6864-40db-847e-e100bc53af90 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:02.792912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:02.804553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:02.805778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.806313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.806812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.807640 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:02.808146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:02.809702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:02.814998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 445/885] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:02.823223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:02.934089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a686-a96f-481b-8491-cf5098ef4b8d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:02.967563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:02.968158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.968430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.968696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.969315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:02.969611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:02.971002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321df1a9-9e39-4ab2-99b3-adcc06ca2023 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:02.976128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 441/886] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:02.982924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:02.983238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559958-29e0-45fd-b48f-1efd37f39c66 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.983518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559958-29e0-45fd-b48f-1efd37f39c66 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.983789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559958-29e0-45fd-b48f-1efd37f39c66 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.985269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 442/887] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:02.991117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.991404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.991679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.011355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:03.012553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:03.038676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.097906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 443/888] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:03.104913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d07b-4bdb-4269-8efc-94e814c3373a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.142088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.143538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.144019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.144489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.145459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] RBAC: Adding query filter params (interface=public, service_id=4a4cdf57046b4a42a6e112f9214bf132, region_id=RegionOne) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:03.146032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.147634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.156797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 446/889] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:02 2022] GET /identity/v3/endpoints?service_id=4a4cdf57046b4a42a6e112f9214bf132&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:03.163156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.267265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196e87-7494-492a-a5f0-dd36001e99da None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.302739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.303261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.303535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.303801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.304395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.306049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.311963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 444/890] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:07:03.363026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.422786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.474960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf7d1-87fb-44a6-8819-c499f3de42e4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.511330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75021103-1a09-4af5-b434-45099139508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.511968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021103-1a09-4af5-b434-45099139508f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.512251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021103-1a09-4af5-b434-45099139508f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.512522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021103-1a09-4af5-b434-45099139508f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.524097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75021103-1a09-4af5-b434-45099139508f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-75021103-1a09-4af5-b434-45099139508f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:03.529473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:03.530500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:03.531369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 447/891] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:03.537378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.566777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.585772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30559db8-7060-4da3-91a5-05673608bd32 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.586111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30559db8-7060-4da3-91a5-05673608bd32 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.586386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30559db8-7060-4da3-91a5-05673608bd32 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.587973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 448/892] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:03.592817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363cf1-f69b-48e8-9e51-10f1d91dc19f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.593096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363cf1-f69b-48e8-9e51-10f1d91dc19f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.593363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85363cf1-f69b-48e8-9e51-10f1d91dc19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.613573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-85363cf1-f69b-48e8-9e51-10f1d91dc19f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:03.614956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-85363cf1-f69b-48e8-9e51-10f1d91dc19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:03.651529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15f21e-9113-4198-b58a-cd28ac1432cf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.695945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.696879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.697353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.698172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.698855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:03.699161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.700531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.701915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 449/893] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:03.703312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef29955-158c-468e-b208-64334e5b5e19 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.703583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef29955-158c-468e-b208-64334e5b5e19 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.705334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef29955-158c-468e-b208-64334e5b5e19 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.705334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 450/894] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:03.710476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 445/895] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:03.712170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.712518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.712871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.715819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.733049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:03.734612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:03.772947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.816896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 451/896] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:03.825123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.841520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceab4f-0d80-4a8b-9352-1e31edb57439 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.880416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.881045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.881324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.881596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.892678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.894148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:03.909283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:03.910353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:03.911281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:03.911281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:03.911281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:03.911281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 446/897] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:03.916543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.986955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.030815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b9781-1806-4208-9249-5191325faff3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.076660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.077987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.078694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.079119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.080178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:04.080689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.083231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.096705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e04e9b-5d89-487a-9e8f-68ab22e5fb35 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.104031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 452/898] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:04.105438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.137953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.138548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.138821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.139084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.139715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.141060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.143986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.155167 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.170064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 447/899] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:03 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:04.171984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.247050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8752ee-8dd2-4a1a-ae28-d337efa969b4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.293365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.294048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.294325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.294595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.298008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4b8ad-f262-4f6d-a3f9-1e9af4cc18a8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.304038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.306516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:04.319613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:04.320584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:04.321569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 453/900] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:04.328744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.342357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.342987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.343260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.343526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.344101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.345462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:04.356728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:04.357738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:04.364642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 448/901] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:04.366772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.441611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.453778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.471708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37627d-2378-42e5-b0b0-68b33a21ff6c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.490637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccafb2-a156-448e-bba3-8fbc6d111c5f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.523034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.524068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.524353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.524825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.525692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:04.526283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.528415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.532695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.533404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.533777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.534173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.534933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:04.535369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.537151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.545953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 449/902] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:04.550328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.554133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 454/903] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:04.562848 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.666196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c8a80-f0f8-4e6b-8222-5d80ee16bcbd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.674292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203839b7-6916-48c6-80fe-323b983dcce5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.706673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.709869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.710709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.711082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.711491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.723677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.724524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.725247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.725666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.726712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:04.727181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.729220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.740942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 450/904] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:04.741095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.742822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.790852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.791906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.863031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac1d0-cf7f-4b94-80ae-d9eb7a790f53 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.902517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 455/905] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:04.904109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.905744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.906643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.907102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.907577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.908411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] RBAC: Adding query filter params (interface=public, service_id=33e121b997c4426baf1e3ffe0760ab7a, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:04.908877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.910955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.916968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 451/906] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/endpoints?service_id=33e121b997c4426baf1e3ffe0760ab7a&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:04.922253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.955310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.990493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.023116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63cde1-bce4-4f7c-ab42-c6bbec6e491f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.046182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247aa96-146b-485a-8023-4845b4e58f80 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.067205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.068176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.068291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.068479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.079550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.081000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.083478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.084378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.084872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.085341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.086181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.087782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.094423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 452/907] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:05.097496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:05.099033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:05.099959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:05.099959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:05.099959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:05.109881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 456/908] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:05.110083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.220268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141930-ff20-49ae-9bb9-1f3b08d5e111 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.236278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.261633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.262316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.262593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.262866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.263503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:05.263800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.265222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230d71-0284-49d3-8f9b-027bc60e528a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.278001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 453/909] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:05.283854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.382847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9bc6-15b0-4b2a-904e-98112a0a28b8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.383526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9bc6-15b0-4b2a-904e-98112a0a28b8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.383998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9bc6-15b0-4b2a-904e-98112a0a28b8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.386036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 454/910] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:05.391390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.392031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afa306-59f8-432d-beca-f38334997d9c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.393948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afa306-59f8-432d-beca-f38334997d9c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.394466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afa306-59f8-432d-beca-f38334997d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.396320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca6717-53a5-4a00-ad4e-48d9d347c449 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.419290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-30afa306-59f8-432d-beca-f38334997d9c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:05.421434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-30afa306-59f8-432d-beca-f38334997d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:05.433648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.434317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.434595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.434863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.442854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.444303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:05.455849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:05.456790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:05.458651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 457/911] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:05.463435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.502870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 455/912] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:05.565118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514939-0974-4930-bdb0-eb292256d112 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.598999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.599601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.599877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.600146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.600830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:05.601128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.602577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.615454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 458/913] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:05.621283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afa306-59f8-432d-beca-f38334997d9c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.721720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afa306-59f8-432d-beca-f38334997d9c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.724574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.761932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.762854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.763331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.763813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.764722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] RBAC: Adding query filter params (role.id=5eccce55b58240518ac72cc9196cb20d, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=7f37e7598e29465ab6182da7ee0e4e2d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:05.765220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.766894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.772112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.774144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 456/914] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/role_assignments?user.id=7f37e7598e29465ab6182da7ee0e4e2d&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=5eccce55b58240518ac72cc9196cb20d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:05.793453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.888730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b89a-1ced-4e3f-a306-49b229efce6c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.926799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.927437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.927711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.927980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.928558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.929947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:05.939501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:05.940497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:05.941332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 459/915] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:05.946527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.049009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547747d-645a-46a3-ae2f-b1892fea82b2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.084142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.085106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.085597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.086099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.086935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:06.087436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.089037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6b8c-0f7a-4c53-983c-68891ef68fdb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.094482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 457/916] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:06.100303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.186141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.205492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180415d3-8217-4eef-ade9-a1a92b16c286 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.237725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb74a-542f-4101-8454-7710d7fe4626 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.238297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb74a-542f-4101-8454-7710d7fe4626 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.238404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb74a-542f-4101-8454-7710d7fe4626 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.239949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 458/917] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:06.241933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.242759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.243226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.243728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.244544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:06.244855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.245140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.245413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.245659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.247288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.253106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 460/918] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:06.259248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.271545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:06.273646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:06.307184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.369980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 459/919] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:06.383284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81001eb1-c301-45c8-b406-66ee3d9c7f0e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.418400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.419335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.419806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.420296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.421133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.422757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.447664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 461/920] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:06.646471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.750805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe62928-11c2-4e99-aa61-d5d4609551e2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.799387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.800426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.800926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.801394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.802203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.803777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:06.817613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:06.823844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:06.825801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:06.837947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 460/921] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:06.839898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.842984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.967251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe0a3c-2757-4f61-ba44-2b2b6098f261 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:07.001198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:07.001810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.002115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.002384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.003012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:07.003309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:07.005230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f092e-114c-4aac-93fe-956dc309ca2e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:07.010485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 462/922] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:07.016011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:07.041611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:07.123298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61625a-8efe-4258-8d92-795f4cb0b633 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:07.162524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:07.163129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.163419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.163677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.164279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:07.164750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:07.166935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:07.175527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 461/923] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:07.179227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5cd6-ce34-498b-b3e1-b0ccf594ea37 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.179505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5cd6-ce34-498b-b3e1-b0ccf594ea37 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.179772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5cd6-ce34-498b-b3e1-b0ccf594ea37 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.181834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 463/924] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:07.183045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:07.188216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.188501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.188775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.207513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:07.208681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:07.269993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:07.271739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:07.278539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 464/925] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:07.295478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461cfe-a5cc-4402-96d6-0705571133df None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:07.333227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:07.333831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.334131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.334399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.335090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] RBAC: Adding query filter params (interface=public, service_id=b9bce1f044b84733bec547c333333187, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:07.335391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:07.336739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:07.342137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 462/926] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:07 2022] GET /identity/v3/endpoints?service_id=b9bce1f044b84733bec547c333333187&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:07.347646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:07.451818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64548efb-7c4b-4312-a6ce-e667df57c054 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:07.488776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:07.489741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.490277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.490778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.491589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:07.493148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:07.500039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 465/927] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:07 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:07:07.592341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:07.700593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2081-616f-421b-abc1-7de3b6e1afac None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:07.735048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:07.735667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.735947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.736213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.736782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:07.738161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3ac86e6d-2af4-42e1-8cd8-c237fd97c671 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:07.746971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:07.747907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:07.748802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 463/928] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 31 00:07:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:07.754678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:07.815372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:07.816183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b9842-822a-4077-99a3-5a16df5687a5 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.816990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b9842-822a-4077-99a3-5a16df5687a5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.817255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b9842-822a-4077-99a3-5a16df5687a5 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.818862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 464/929] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:07.823994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.824614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.824614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.842991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:07.844144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:07.859733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:07.873513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92facd6-d72f-4e15-9e78-897da7f6c13d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:07.915413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:07.916325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.916781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.917258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.918148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:07.918625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:07.920225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:07.929976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 466/930] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:07.931768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:07.933921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 465/931] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:08.034957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b55c-e9eb-4b54-8f0e-da3137e8c0e5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.068973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.071761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.072597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.073178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.073648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.074517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:08.075019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:08.076657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:08.086131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 467/932] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:08.088546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.188445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752c63b-655f-4e11-8d25-9a9c11212e4c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.220438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.223237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.224280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.225566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.226076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.226956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:08.228518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:08.248949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.262050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 466/933] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:08.343030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe5bdd-18e4-43d4-99f2-c37038f853aa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.389113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d22692-7706-483a-b19d-31a340720c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.389734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d22692-7706-483a-b19d-31a340720c6f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.390076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d22692-7706-483a-b19d-31a340720c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.390343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d22692-7706-483a-b19d-31a340720c6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.402543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d22692-7706-483a-b19d-31a340720c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-31d22692-7706-483a-b19d-31a340720c6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:08.407554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:08.408527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:08.409758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 468/934] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:08.415495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.462303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d9ff-6a74-42f4-95e5-c7bffbf9729b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.462796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d9ff-6a74-42f4-95e5-c7bffbf9729b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.462796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d9ff-6a74-42f4-95e5-c7bffbf9729b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.464299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 469/935] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:08.469358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.469643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.469950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.492058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:08.493244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:08.536179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759bfe-180c-4071-8a25-735b2446cc6d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.543708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.574265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 470/936] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:08.582907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.583516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.583800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.584069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.584736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:08.585035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:08.586483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:08.595427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 467/937] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:08.600961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.701167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d54162-7198-4369-b4c3-c7c287fe39b5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.742142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.742777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.743054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.743324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.754618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:08.756091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:08.770016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:08.770964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:08.771871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:08.771871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:08.771871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:08.771871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 471/938] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:08.777561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.841874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.858440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.889627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41584ee-749b-4165-91bb-4cb5faea0b44 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.892079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.932964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.933574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.933881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.934154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.934797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:08.935097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:08.936456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:08.953934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 468/939] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:08.957888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.978887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72253c-a414-4c98-8528-689f4cf08acb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.025759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.026329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.026612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.026885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.027969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.029669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.033239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING keystone.server.flask.common [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:07:09.057964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.sql.core [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:07:09.057964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:07:09.057964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [parameters: {'id': 'a67f9df8e34f4af192efc3df7d5b0905', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:07:09.057964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81516) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a67f9df8e34f4af192efc3df7d5b0905.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a67f9df8e34f4af192efc3df7d5b0905. Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:07:09.066636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 00:07:09.067497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application yield resource Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise self.value Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application session.commit() Aug 31 00:07:09.068509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:07:09.069401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:07:09.070378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:07:09.071188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [parameters: {'id': 'a67f9df8e34f4af192efc3df7d5b0905', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.072062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.072839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a67f9df8e34f4af192efc3df7d5b0905. Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.080250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 472/940] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Aug 31 00:07:08 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.081519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2842-0c62-4a67-95cb-cd44b43ece1d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.083679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.107564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.123419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.124081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.125122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.125400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.134435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.136184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:09.153350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.154406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:09.155367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:09.157921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 469/941] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:09.163573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.185083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.209114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fcc58-4a5b-434c-bd6e-b4fdcffc793b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.245438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.246474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.246967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.247461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.256493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.258337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:09.271553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.272644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:09.273767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:09.280164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 473/942] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:09.281155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.297966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce5f1-2d9b-40ab-9f0e-90d0d8784b6e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.335452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.336060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.336340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.336614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.337347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.337654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.339129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.357180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 470/943] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.362717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.391052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6ba23-2ba6-486d-a26a-508a8155f6fc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.414779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.434332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.435426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.435781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.436366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.437111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.437718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.439929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.468473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 474/944] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.486172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc19b75-039b-4919-8837-9cb438c32919 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.527800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.528602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.528985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.529356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.541521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.543133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-16e35cb6-bd10-4d27-92e8-6a1a76551534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:09.560625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.561875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:09.562969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:09.562969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:09.562969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:09.564273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 471/945] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:09.571196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.573030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f380-411e-49f2-8934-97f1d5c309be None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.573380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f380-411e-49f2-8934-97f1d5c309be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.573719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f380-411e-49f2-8934-97f1d5c309be None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.574526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.577206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 472/946] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:09.586706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.587282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.587652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.613769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:09.615049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:09.689417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429633b0-f1f9-4869-9ba2-29f4cae1dcbb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.711192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 473/947] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:09.735426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.736130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.736482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.736874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.737591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.737999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.739961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.753399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 475/948] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.759807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.784625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.865792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aac77-defb-43d1-9ea2-7ce7eb42c89c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.900740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.901376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.901651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.901948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.908741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.910734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:09.924998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.926536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:09.927422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:09.931706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 474/949] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.933258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.993206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.007609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.049437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c6003-be1f-40dd-931d-4c7bab164cc8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.085510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.086953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.087796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.088276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.088775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.089713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.090253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.092777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.105809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1a1f-c144-46fa-9fc1-68e1c6b0a55b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.107441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 476/950] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:10.114512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.155168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.155854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.156231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.156618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.157301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.158797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.168586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.169825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:10.170904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:10.178120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 475/951] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:10.179722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.263035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a2a2-8f0c-4b87-951d-03553005dda5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.284318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910ed38-71a3-4b22-9a77-eaae3532bdf5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.295410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.313191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad7b0b-9a92-49b1-9de3-bdeb0dac01d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.314375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad7b0b-9a92-49b1-9de3-bdeb0dac01d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.314804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad7b0b-9a92-49b1-9de3-bdeb0dac01d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.315745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad7b0b-9a92-49b1-9de3-bdeb0dac01d3 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/7f37e7598e29465ab6182da7ee0e4e2d/roles/5eccce55b58240518ac72cc9196cb20d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.319261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad7b0b-9a92-49b1-9de3-bdeb0dac01d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=7f37e7598e29465ab6182da7ee0e4e2d, role_id=5eccce55b58240518ac72cc9196cb20d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.321290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad7b0b-9a92-49b1-9de3-bdeb0dac01d3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.323550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.324339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.324713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.325081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.325813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.326246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.327611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57660ac3-3a39-437b-8693-2faff5686ad6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.333260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 476/952] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:10.334550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e3de-9d31-40d9-b90e-a9dbde9cb12e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.334818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e3de-9d31-40d9-b90e-a9dbde9cb12e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.335089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e3de-9d31-40d9-b90e-a9dbde9cb12e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.336479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 477/953] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:10.340904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 477/954] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:10 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/7f37e7598e29465ab6182da7ee0e4e2d/roles/5eccce55b58240518ac72cc9196cb20d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:10.341068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e3de-9d31-40d9-b90e-a9dbde9cb12e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.342574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.343006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.343544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.353761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.366449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:10.368400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:10.469773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 478/955] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:10.472063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e3de-9d31-40d9-b90e-a9dbde9cb12e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.513781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.514416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.514682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.514953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.515588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.515890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.517271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.523310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 478/956] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.528807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.631206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9be9c-c706-4505-8e3b-0ba932be392a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.646713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.667337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.667944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.668219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.668509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.669192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.670577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.693971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 479/957] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:10.769347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.878009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.905475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0191b4-9c67-488f-aafd-cd71e7531276 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.946764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.947394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.947670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.947938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.948512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.949893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.960056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.961210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:10.962162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 479/958] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.967023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.081197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d323-7d7d-4dfb-add9-44fae7140687 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.117614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.118706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.119190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.119681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.120509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.121012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.122618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d95c-da14-4e81-aad2-37694981c627 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.128380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 480/959] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.135200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.246485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f779d1-7f18-45e0-a900-8fb7b48f4a6f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.282733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.283729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.284230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.284716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.286125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.286635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.288216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb940d-24f9-4c86-a421-d5cb25b1fac7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.289740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.293474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 480/960] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.646168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeae44-5168-4867-83c2-36e4923a743f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.646798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeae44-5168-4867-83c2-36e4923a743f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.646968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeae44-5168-4867-83c2-36e4923a743f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.648698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 481/961] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:11.653919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.654359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.654669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.673349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:11.674575 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:11.744091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 481/962] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:12.022194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeae44-5168-4867-83c2-36e4923a743f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.055653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.129766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeae44-5168-4867-83c2-36e4923a743f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.164011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.164625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.164903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.165177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.165831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.167296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.184775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.sql.core [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:07:12.184775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:07:12.184775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [parameters: {'user_id': '9388b9716bfe467f8a1bfd3353a1dc63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:07:12.184775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81516) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0cb29033-d042-436b-91d6-f79b9a8e61cd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 31 00:07:12.192418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:07:12.193347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application yield resource Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise self.value Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application session.commit() Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:07:12.194401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:07:12.195338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:07:12.196257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:07:12.197147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [parameters: {'user_id': '9388b9716bfe467f8a1bfd3353a1dc63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:12.199217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 00:07:12.201267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:12.203748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 482/963] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 31 00:07:12 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:12.208569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.303649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2f0f-7228-4516-b7b6-9662b347dfb8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.330799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.339034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.339678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.339956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.340228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.342828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac047e-68ac-4f0d-945d-48b446a8065a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.343110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac047e-68ac-4f0d-945d-48b446a8065a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.343380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac047e-68ac-4f0d-945d-48b446a8065a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.348658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 483/964] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:12.355585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.356456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.358057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.358564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.359068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:12.370496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:12.371495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:12.373588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 482/965] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:12.377400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.388969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:12.391552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:12.470072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 484/966] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:12.500119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2bec4-7763-4d76-9e62-e31c58977f53 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.534606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f784-45ad-459b-893f-23815271822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.535235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f784-45ad-459b-893f-23815271822c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.535512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f784-45ad-459b-893f-23815271822c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.535779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f784-45ad-459b-893f-23815271822c None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.536480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f784-45ad-459b-893f-23815271822c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.536779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f784-45ad-459b-893f-23815271822c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.538288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f784-45ad-459b-893f-23815271822c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.578197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 483/967] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:12.743302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.770312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.795093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659d78-1a58-4c4d-bc26-59ea07b91481 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.796139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659d78-1a58-4c4d-bc26-59ea07b91481 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.796653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659d78-1a58-4c4d-bc26-59ea07b91481 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.798186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 484/968] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:12.804455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c555b-e994-465a-80db-399cf9651868 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.804740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c555b-e994-465a-80db-399cf9651868 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.805017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c555b-e994-465a-80db-399cf9651868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.828346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e01c555b-e994-465a-80db-399cf9651868 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:12.829975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e01c555b-e994-465a-80db-399cf9651868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:12.868620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042918-b1ff-4f79-a9eb-67aad29bc48c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.881064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.905274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.905933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.906211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.906478 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.912857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 485/969] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:12.921729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:12.927246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:12.928206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:12.929074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:12.930646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 485/970] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:12.934544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c555b-e994-465a-80db-399cf9651868 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.033445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c555b-e994-465a-80db-399cf9651868 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.067662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.068266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.068543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.068816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.069478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.069780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.071176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.083604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 486/971] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.085078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.172548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.183059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.190773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb608c-d241-4e7d-b479-cd5fc3c56283 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.225475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.227119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.227875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.228143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.228411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.239755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.241543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e09d064d-31d7-4385-a948-6122a76697ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:13.255636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:13.256794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:13.257705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:13.257705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:13.257705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:13.257705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 486/972] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:13.258005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e280ed7-472e-4928-80ae-53edb495261b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.258208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e280ed7-472e-4928-80ae-53edb495261b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.258387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e280ed7-472e-4928-80ae-53edb495261b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.259598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 487/973] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:13.262436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e280ed7-472e-4928-80ae-53edb495261b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.292784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bea4e6-91b7-4d86-bba8-d431a07a6a03 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.325272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.326000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.326340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.326674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.327323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.328676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b21661d0-6eb1-48b4-9a99-409164eebf8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:13.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:13.339197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:13.340332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 487/974] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:13.343079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.343359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.343626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.361074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:13.362273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:13.365561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e280ed7-472e-4928-80ae-53edb495261b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.398022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.398617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.398889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.399154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.399780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.400076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.401426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.404471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.414227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 488/975] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.415215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.431356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 488/976] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:13.432188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.464144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.518700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bb19c-5abe-42b2-8dbb-af50817bac5c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.533009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89136fa-9892-4171-b7e1-f76d2fee4abe None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.554944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.556117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.556666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.557147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.557947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.558404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.560073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.565235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 489/977] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.567122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.567920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.568342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.568768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.570561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.576550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.578009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:13.589460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:13.590756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:13.591818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 489/978] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:13.596198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.636090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.681344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc1248-af3a-49e0-a7a0-9f41e99fccbc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.691798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.700730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7bb8f-ef9d-4d3b-9ca2-042b517f469b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.716939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.717540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.717813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.718112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.718729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.719029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.720387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.725453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 490/979] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.726223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.739644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.740244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.740522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.740787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.741511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.741815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.743259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.764242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 490/980] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:13.764242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.825620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16396-2027-4040-8770-48b5e954e08e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.848986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.860305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.860914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.861191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.861460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.861550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89aca-3509-4f28-baf8-3c729e7d99a6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.862135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.864064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.878253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 491/981] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:13 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:13.879057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.914700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.914700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.916117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.916117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.916117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] RBAC: Adding query filter params (interface=admin, service_id=b9bce1f044b84733bec547c333333187, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.916326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.917662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.923676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 491/982] 10.222.0.49 () {56 vars in 1249 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/endpoints?service_id=b9bce1f044b84733bec547c333333187&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.934699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.949963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.012041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67156-a6d3-4b73-a28a-78793452da2d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.049366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6c4b1-cab0-4aea-bf50-aca7059bdc07 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.051273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.051884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.052170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.052447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.088217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.088822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.089102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.089375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.090021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.091388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.098323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 492/983] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:07:14.110196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.129648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.131165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.241008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 492/984] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:14.246097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.332424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.360302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242d49c-1a26-4c0b-b1ad-3b23fc7422fe None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.396456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.397087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.397367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.397640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.408005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.409457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:14.426549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:14.427555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:14.428472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:14.428472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:14.428472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:14.428472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 493/985] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:14.434750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.517832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.537101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73affa-3363-494c-be15-9d50bcafd916 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.575633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.576237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.576512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.576781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.577417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.577718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.579113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.593875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 493/986] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:14.596147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.696019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b909e-9b59-4b96-b8be-1182f200bacc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.720198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.730298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.730924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.731201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.731470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.738713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.740148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:14.751271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:14.752205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:14.753159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:14.757134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 494/987] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:14.758366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.896777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f614d-6dfa-48f9-b0b2-91bb27bead02 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.930572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.931177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.931459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.931734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.932421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.932725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.934184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128321b3-0a61-41f5-864d-f2d27a4b012c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.950863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 494/988] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:14.951980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:15.058480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eec7f-3867-40cf-8ea8-3d92c5d39db2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.092944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.093614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.093926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.094204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.094930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] RBAC: Adding query filter params (role.id=5eccce55b58240518ac72cc9196cb20d, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=7f37e7598e29465ab6182da7ee0e4e2d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:15.095241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.096671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8899-2d83-4a7f-bfaf-38c4bce377aa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.103614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 495/989] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/role_assignments?user.id=7f37e7598e29465ab6182da7ee0e4e2d&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=5eccce55b58240518ac72cc9196cb20d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:15.796819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905fb7-38ee-4c25-8fc8-6d2dd94e50fd None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.797205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905fb7-38ee-4c25-8fc8-6d2dd94e50fd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.797406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905fb7-38ee-4c25-8fc8-6d2dd94e50fd None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.798794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 495/990] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:15.804343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5fea-4463-4292-9066-0c487a69ca3a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.804625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5fea-4463-4292-9066-0c487a69ca3a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.804891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5fea-4463-4292-9066-0c487a69ca3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.823949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-24ae5fea-4463-4292-9066-0c487a69ca3a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:15.825125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-24ae5fea-4463-4292-9066-0c487a69ca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:15.877766 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.899984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 496/991] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:16.064513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107abb-1d74-4e61-b652-a38db69c01b8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.064997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107abb-1d74-4e61-b652-a38db69c01b8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.064997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107abb-1d74-4e61-b652-a38db69c01b8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.066548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 496/992] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:16.071428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.071827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.071996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.090371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:16.091561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:16.158338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 497/993] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:16.164454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0107abb-1d74-4e61-b652-a38db69c01b8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.168244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.278566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0107abb-1d74-4e61-b652-a38db69c01b8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.312013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.312631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.312904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.313168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.313732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.315168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.324201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.325226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:16.326119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:16.330223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 497/994] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:16.331394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.424377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.431372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2ef3-0146-49c7-b3bb-3b9a5f7856ee None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.442195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.468223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.468829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.469108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.469382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.470053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.470362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.471731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.477116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 498/995] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.483385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.503501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.549591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882592f-c890-4f18-9070-dc583179a618 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.592064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2076-1e25-406c-80a0-71cd6e3494e2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.592995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.593658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.593969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.594235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.595198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.596180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.605838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.606858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:16.607702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 498/996] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:16.612863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.634032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.634914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.635375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.636267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.637360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.637875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.640180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.646240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 499/997] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:16.651850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.693613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.723357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b5e46-8094-4ad9-a329-9b46d4f00666 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.754528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.760592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1779d-8705-4300-b7a6-4c75f55ce7dd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.760842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.761415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.761693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.761999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.762617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.762913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.764297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.769391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 499/998] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:16.774906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.798632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.799734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.800248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.801347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.802264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] RBAC: Adding query filter params (interface=public, service_id=913535c260284c22a4ad71bbbd5fcf91, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.802721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.804500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.810483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 500/999] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/endpoints?service_id=913535c260284c22a4ad71bbbd5fcf91&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:16.815539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.888863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82c314-d59c-4b83-bc87-4d4da384b4e2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.928675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc77ae8-f89b-4838-a175-be1cd5d03198 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.930575 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.932412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.933005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.933308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.933551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.934215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.934517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.935883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.942756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 500/1000] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:16.948251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.968662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b940-c1ac-4c5b-a9f7-c17a0f0b2bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.969486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b940-c1ac-4c5b-a9f7-c17a0f0b2bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.969979 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b940-c1ac-4c5b-a9f7-c17a0f0b2bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.970824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b940-c1ac-4c5b-a9f7-c17a0f0b2bf7 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.971594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b940-c1ac-4c5b-a9f7-c17a0f0b2bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.973632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b940-c1ac-4c5b-a9f7-c17a0f0b2bf7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.980515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 501/1001] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:07:17.021597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.045651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61efe-5e9a-4a51-afd1-c7f785376169 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.046009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61efe-5e9a-4a51-afd1-c7f785376169 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.046222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61efe-5e9a-4a51-afd1-c7f785376169 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.047595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 502/1002] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:17.053129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.053407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.053681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.069214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f3b47-e6b9-4430-b633-26bba11f6dd7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.072508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:17.073724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:17.107033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.107658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.107992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.108260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.108866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.110286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.131376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 501/1003] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:17.159547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 503/1004] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:17.429565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.531843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46b2e2-43c9-493c-b9bd-68fe85ebbe8d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.551216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.568160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.568160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.568160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.568160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] PATH_INFO: `/v3/services/image` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.568676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.570088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:17.579012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:17.580178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:17.581162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 502/1005] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:17.586793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.677829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.687842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096acea0-2ed5-42bb-a948-e33a70872b59 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.721422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.722046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.722351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.722622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.723239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:17.723538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.724894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa8249-11b6-4bee-b6be-fe679f8399a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.729701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 504/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:17.735271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.834734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7de8b-6a23-4abb-bab7-99c170608100 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.873666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.874309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.874588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.874861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.875486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:17.875789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.877150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99e5de-392d-4de5-8a46-d847487d2cd4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.890160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 503/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:18.884497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd709f-7fa3-482c-ba5e-a5b6ee1d37f7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.884977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd709f-7fa3-482c-ba5e-a5b6ee1d37f7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.885057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd709f-7fa3-482c-ba5e-a5b6ee1d37f7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.886527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 505/1008] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:18.891321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847118-5a01-45e5-b376-07bba56e452d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.891740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847118-5a01-45e5-b376-07bba56e452d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.891939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847118-5a01-45e5-b376-07bba56e452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.910377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b2847118-5a01-45e5-b376-07bba56e452d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:18.911542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b2847118-5a01-45e5-b376-07bba56e452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:18.959223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.983239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 504/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:19.047217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e610-084c-4d24-ba1c-c0310508a506 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.047535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e610-084c-4d24-ba1c-c0310508a506 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.047767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0e610-084c-4d24-ba1c-c0310508a506 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.049229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 506/1010] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:19.054118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.054408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.054681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.073334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:19.074529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:19.140190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 505/1011] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:19.244251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e610-084c-4d24-ba1c-c0310508a506 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.347895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0e610-084c-4d24-ba1c-c0310508a506 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.381940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.382561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.382835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.383109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.383724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.385487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.397261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.398487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:07:19.399327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:19.402170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 507/1012] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.404062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.417965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.444216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.513128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e9cb4-bf13-45b3-a52f-1a38def4abb2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.523995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.526321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16179-83d3-4981-b9fb-4e619134ec44 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.553222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.553827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.554146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.554420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.555041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.555591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.556956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.561804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 506/1013] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:19.567010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.567302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.567641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.567923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.568311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.569441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.570905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.572463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 508/1014] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:19.577937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.673920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.682239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a38d48-773a-40c6-9bb9-18ee61b3cc21 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.688466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071645fd-8f3d-400b-b7e2-86450cec332e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.717909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.718538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.718806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.719074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.719715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.720014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.721362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.723422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e08ac8-cab2-4647-ba62-36e6e5824167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.724035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e08ac8-cab2-4647-ba62-36e6e5824167 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.724315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e08ac8-cab2-4647-ba62-36e6e5824167 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.724588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e08ac8-cab2-4647-ba62-36e6e5824167 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.725231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e08ac8-cab2-4647-ba62-36e6e5824167 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.726673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e08ac8-cab2-4647-ba62-36e6e5824167 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.731649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 507/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:19.732504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.756401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 509/1016] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:19 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:19.768092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3521-5c93-4535-9101-13fd9eed90a8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.768372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3521-5c93-4535-9101-13fd9eed90a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.768638 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3521-5c93-4535-9101-13fd9eed90a8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.770105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 510/1017] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:19.775830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.776235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.776506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.782208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.795998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:19.797209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:19.860957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df40b8-11b2-48b5-9563-820ea47a3dc4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.888888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 511/1018] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:19.904557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3e73-1692-4ce0-abe2-930284cd6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.905227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3e73-1692-4ce0-abe2-930284cd6826 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.905509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3e73-1692-4ce0-abe2-930284cd6826 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.905835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3e73-1692-4ce0-abe2-930284cd6826 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.906537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3e73-1692-4ce0-abe2-930284cd6826 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.907906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3e73-1692-4ce0-abe2-930284cd6826 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.930030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 508/1019] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:20.165728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.238639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.272177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d719e3a-cc4d-42c5-bb3b-e1b5ffd5f779 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.312554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b3c9-3279-4a1e-91f1-21cb9c4e67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.313157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b3c9-3279-4a1e-91f1-21cb9c4e67b2 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.313432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b3c9-3279-4a1e-91f1-21cb9c4e67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.313702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b3c9-3279-4a1e-91f1-21cb9c4e67b2 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.314423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b3c9-3279-4a1e-91f1-21cb9c4e67b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.315921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b3c9-3279-4a1e-91f1-21cb9c4e67b2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.335246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 512/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:20 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:21.750354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e1136-6983-467e-a26f-d433d3dfd1d0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.750873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e1136-6983-467e-a26f-d433d3dfd1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.750980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e1136-6983-467e-a26f-d433d3dfd1d0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.752277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 509/1021] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:21.757397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53b588-62fc-4de0-beb2-ff679feb782c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.757785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53b588-62fc-4de0-beb2-ff679feb782c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.757987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53b588-62fc-4de0-beb2-ff679feb782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.776613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ac53b588-62fc-4de0-beb2-ff679feb782c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:21.777809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ac53b588-62fc-4de0-beb2-ff679feb782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:21.853948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 513/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:21.920591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25b4f-af8f-4d89-916e-e852628f615b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.920893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25b4f-af8f-4d89-916e-e852628f615b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.921136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25b4f-af8f-4d89-916e-e852628f615b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.922677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 510/1023] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:21.928202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430472-4b1b-4cc9-93f9-a862b09aca35 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.928472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430472-4b1b-4cc9-93f9-a862b09aca35 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.928754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430472-4b1b-4cc9-93f9-a862b09aca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.947600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d1430472-4b1b-4cc9-93f9-a862b09aca35 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:21.948803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d1430472-4b1b-4cc9-93f9-a862b09aca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:21.997266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.021968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 514/1024] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:22.129095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25b4f-af8f-4d89-916e-e852628f615b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.223176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.235003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25b4f-af8f-4d89-916e-e852628f615b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.258035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678a626-5fc8-4486-a21e-e047df07801b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.258316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678a626-5fc8-4486-a21e-e047df07801b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.258583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678a626-5fc8-4486-a21e-e047df07801b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.259907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 515/1025] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:22.264805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.265155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.265531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.273959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.274533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.274812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.275081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.276184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.277616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.279380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 511/1026] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.285108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:22.285362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.286327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:22.352686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 516/1027] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:22.353511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.386056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73793009-b7ae-4cf1-86d1-5eb2f20e2f8d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.427228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.427836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.428105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.428376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.429016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.430743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.453916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 512/1028] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:22 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:22.466785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97208-8a70-4ca5-ba7a-43ea3d4b9877 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.483116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.507794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.508493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.508779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.509052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.522339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:22.527687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:22.528689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:22.529552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:22.533981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 517/1029] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:22.535707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.556753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.636398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.646409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f05a-d97a-46d5-b020-6d2ac9704b8f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.683812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.684587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.684707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.685005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.685673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.686020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.687399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.699606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 513/1030] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:22.705736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.751673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54f987-2355-4dd0-97c3-f95eefc091e0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.789145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.789759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.790244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.790404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] PATH_INFO: `/v3/services/image` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.790843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.791233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.792678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:22.802791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:22.803818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:22.804669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 518/1031] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:22.810036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.817879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250d36-7e82-4a59-8cdf-dd851717385f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.850123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.858841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.859483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.859818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.860092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.874733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.876196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:22.891013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:22.891981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:22.892894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:22.892894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:22.892894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:22.892894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 514/1032] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:22.897913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.925090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522738c-351a-4f70-9edb-56b05946530c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.963611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.964218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.964497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.964771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.965400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.965731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.967124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.973386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 519/1033] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:22.979419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.003279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91769be1-fe8b-40f1-892e-67b386138819 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.032519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.039810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.040817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.041275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.041737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.042590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.043069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.044619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.062392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 515/1034] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:23.068155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.090471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.093473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2928def-fab6-4246-b609-7a89215710d9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.131586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.132195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.132630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.132905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.133872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] RBAC: Adding query filter params (type=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.134455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.136053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.146003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 520/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:23.148699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.180351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b7df7-85af-45eb-9b30-f28040de04e1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.217808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.218460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.218739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.219010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.226715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.228282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:23.240806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:23.241753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:23.243345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 516/1036] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:23.247544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.250756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de0f2-01c9-4174-a81a-f6d1c7634362 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.290000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.290545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.290828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.291103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.291799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] RBAC: Adding query filter params (interface=public, service_id=cf3e6e5ba9aa4fdc926a98dc9fdd66c5, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.292109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.293541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.296967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.303520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 521/1037] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/endpoints?service_id=cf3e6e5ba9aa4fdc926a98dc9fdd66c5&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:23.304515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.333258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.355454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ece9-b214-4caf-8956-3009f4e4acd5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.393631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.394566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.394992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.395416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.396297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.396775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.398230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.409063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12f36-3fa0-422a-a86e-683843eeb7fa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.416595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 517/1038] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:23.421832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.448893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.449495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.449771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.450262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.450661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.452014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.458716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 522/1039] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:07:23.531056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3e94-c153-4d45-b149-ef3a1c4ca631 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.549184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.578847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.579472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.579751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.580023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.657198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.658695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.756978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 518/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:23.762680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.853581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.870418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88411-2c23-4267-b5ce-a30f7aed3e90 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.904936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.905957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.906416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.906864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.918139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.919865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:23.934895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:23.935893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:23.936859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:23.936859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:23.936859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:23.937258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 523/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:23.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.953935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.046881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd99b-7be1-47c8-9615-6126689e4edc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.082183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.082792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.083071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.083342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.083978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:24.084282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.085643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.097239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 519/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.102664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.202859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e4520-9894-4b64-9426-7797fde78b22 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.235864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.236489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.236769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.237043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.243748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.245187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:24.256782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:24.257651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:24.258577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 524/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:24.265109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.331837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.366956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81be31-b374-4858-a103-c1a4f637e196 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.400369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.400980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.401260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.401532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.402244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:24.402550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.403975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89075ae-1108-4f52-930c-da0eefca4850 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.421612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 520/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.422892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.426826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.469486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7506-5bf3-4fc8-acdd-a8816d1f40be None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.469668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7506-5bf3-4fc8-acdd-a8816d1f40be None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.469979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7506-5bf3-4fc8-acdd-a8816d1f40be None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.471316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 521/1045] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:24.476953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.477231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.477503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.496280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:24.497458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:24.528917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac2ed-2605-4a6c-b02e-3a4ba239165d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.565075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.566256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.566541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.566817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.567539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] RBAC: Adding query filter params (role.id=5eccce55b58240518ac72cc9196cb20d, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=5d50090e8a924a76b634807f00734c39) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:24.567846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.569286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.572492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 522/1046] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:24.577892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 525/1047] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/role_assignments?user.id=5d50090e8a924a76b634807f00734c39&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=5eccce55b58240518ac72cc9196cb20d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.840314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.905877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.949553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f122dcb-ab15-4f98-8e32-db3f332386d7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.984319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.984951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.985229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.985494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.996689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:25.001561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.002706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:25.003610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:25.006186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 523/1048] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:25.008592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.076597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.112004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea38368-42c6-4230-901b-574e5bc20786 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.145812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.146701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.147125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.147544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.148347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.148795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.150344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.164358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 526/1049] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.165580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.267193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085cd14-6831-48b5-b17c-ee779f990adf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.285324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.302863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29a3f7-e595-4469-9a9f-41381a33bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.303491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29a3f7-e595-4469-9a9f-41381a33bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.303769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29a3f7-e595-4469-9a9f-41381a33bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.304042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29a3f7-e595-4469-9a9f-41381a33bdb9 None admin] PATH_INFO: `/v3/users/0137fd6d4660462d8d46a2380fa5aeaa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.317358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29a3f7-e595-4469-9a9f-41381a33bdb9 None admin] RBAC: Authorizing `identity:get_user(user_id=0137fd6d4660462d8d46a2380fa5aeaa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.318825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29a3f7-e595-4469-9a9f-41381a33bdb9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.325153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 524/1050] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/users/0137fd6d4660462d8d46a2380fa5aeaa => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.326184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.396942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac339-4706-4b3b-a580-49b4ff988050 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.397240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac339-4706-4b3b-a580-49b4ff988050 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.397408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac339-4706-4b3b-a580-49b4ff988050 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.398902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 525/1051] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:25.403538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.403854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.404126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.423112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:25.424276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:25.426416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef78f-2d2f-4217-bb46-590d9903e79e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.455548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.463926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.464526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.464805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.465076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.492588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 526/1052] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:25.537161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.539139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.644529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 527/1053] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:25.645709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.745528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdabff-9ce7-48f0-abc8-080ffc8bb5c1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.752676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.768225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.783038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.783676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.783954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.784477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.785387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] RBAC: Authorizing `identity:get_project(project_id=73366a6a3ed640f4bfc83841d046ce8e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.786840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.793674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 527/1054] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:25.794410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.800574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.884414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6166-91c1-4bdf-abff-a9c2d967837c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.901248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f6d5-fa4b-4c78-9eba-f64b56079165 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.921127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.921756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.922339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.922451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.922950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.924328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.933386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.934433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:25.935289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 528/1055] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:25.939119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.940018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.940305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.940402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.941104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.941975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=73366a6a3ed640f4bfc83841d046ce8e, user.id=0137fd6d4660462d8d46a2380fa5aeaa) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.942279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.943717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.949483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 528/1056] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/role_assignments?user.id=0137fd6d4660462d8d46a2380fa5aeaa&scope.project.id=73366a6a3ed640f4bfc83841d046ce8e&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.049475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.059252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f942419-ddfc-4ad3-bc91-8c5780c9fcc1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.095710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.096682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.096961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.097234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.098062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.098426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.099830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.105124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 529/1057] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:26.110808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.153565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.216958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4de29-215e-4f3b-91ad-fe55b7d6dadc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.250760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.251365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.251645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.251918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.252544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] RBAC: Adding query filter params (type=image) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.252845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.254860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714cdab-23ea-4bac-9e04-8e3cb7e2f385 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.264603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 529/1058] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.265498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.365677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3d6c4-ff57-4042-97d5-8ed4f410a5db None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.402277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ad384-4c89-4cdd-8a16-dffb31fa92f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.402889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ad384-4c89-4cdd-8a16-dffb31fa92f6 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.403168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ad384-4c89-4cdd-8a16-dffb31fa92f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.403440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ad384-4c89-4cdd-8a16-dffb31fa92f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.404112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ad384-4c89-4cdd-8a16-dffb31fa92f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.405470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ad384-4c89-4cdd-8a16-dffb31fa92f6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.433885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 530/1059] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:26.463116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508198a1-6514-4666-afcb-b7505905b110 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.463419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508198a1-6514-4666-afcb-b7505905b110 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.463681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508198a1-6514-4666-afcb-b7505905b110 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.465265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 530/1060] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:26.470952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.471231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.471508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.491814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:26.493093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:26.504599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.577554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 531/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:26.850418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508198a1-6514-4666-afcb-b7505905b110 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.955256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508198a1-6514-4666-afcb-b7505905b110 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.957315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.991012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.991636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.991912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.992182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.003332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:27.008421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.009443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:27.010714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:27.014392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 531/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:27.015644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.118711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58e1e-6bcc-4bc8-abf5-47d82b1d969b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.159963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.160561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.160836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.161103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.161756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:27.162078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.163427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.171203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 532/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:27.176660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.276517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5abc29-f2ea-4f69-8fdc-45fa04588909 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.308812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.309431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.309701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.309995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.321675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.323126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:27.337411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.338750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:27.339668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:27.339668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:27.339668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:27.342160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 532/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:27.344145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.347058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.448435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da95f6-bf13-43c9-a3f3-e4b3263f216c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.482848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.483453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.483738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.484009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.484652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:27.484956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.486383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.503871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 533/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:27.505102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.522015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.618551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f4c64-56ea-424f-8e2b-62519368549f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.652335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.652961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.653240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.653512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.660983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.662451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b5510ea9-c818-450d-a76e-4a3c918fd4e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:27.673418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.679630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:27.680885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 533/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:27.681492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.742171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.781707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9825-a87f-4a1a-ab01-7e51452128b9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.816555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.817160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.817438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.817710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.818468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:27.818774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.820203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.841962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 534/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:27.842152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae6f4f-977c-4bb6-8dd3-ad949dbe45ff None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.842152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae6f4f-977c-4bb6-8dd3-ad949dbe45ff None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.842152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae6f4f-977c-4bb6-8dd3-ad949dbe45ff None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.842979 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.845881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 534/1068] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:27.848149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.848617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.849071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.872719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:27.873931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:27.945147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 535/1069] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:27.961775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8a5b-39ff-47a9-b05c-3eafe28e430a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.983137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.998743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.999305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.999584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.999857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.010299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.011742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:28.026345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.027291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:28.028199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:28.028199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:28.028199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:28.028199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 535/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:28.035629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.039115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.135917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ddc64-d899-4923-8f62-b51c5f351f3d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.172509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.173113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.173390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.173661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.174320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.174619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.176606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.188302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 536/1071] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:28.193801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.242676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.301001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cf308-67c1-4479-86f8-6b4cf83d3401 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.308115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.338121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.338744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.339023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.339292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.345676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.347765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.350214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de373a8-5a84-4c33-ab1c-c59a133ca3b5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:28.358720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.359792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:28.360726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 536/1072] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.365450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.392268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dc552-609c-427a-a733-ed7007da11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.393055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dc552-609c-427a-a733-ed7007da11cc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.393354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dc552-609c-427a-a733-ed7007da11cc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.394270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dc552-609c-427a-a733-ed7007da11cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.397351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.406224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dc552-609c-427a-a733-ed7007da11cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-761dc552-609c-427a-a733-ed7007da11cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:28.411647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.414390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:28.415654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:28.417870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 537/1073] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.419149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824816-6f71-424c-abe0-0dfe63263545 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.419429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824816-6f71-424c-abe0-0dfe63263545 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.419701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824816-6f71-424c-abe0-0dfe63263545 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.420977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 538/1074] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:28.421662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824816-6f71-424c-abe0-0dfe63263545 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.471052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c62cf-3c93-4657-b121-ccc53f31c8cc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.502976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.503563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.503834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.504102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.504778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.505077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.506519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb43993-71ae-47b1-b107-78eec988c8ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.518171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 537/1075] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.519856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.520136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.520406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.531333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824816-6f71-424c-abe0-0dfe63263545 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.538716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:28.539909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:28.558744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.570221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.570822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.571096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.571364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.572013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.572310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.573669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.585769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 539/1076] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.586730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.621992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 538/1077] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:28.622833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.653003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.722433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1153d4-0264-43cf-b86d-478a755a6c31 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.738740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d612b9-c8bb-494e-a83c-0ef482800a1c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.759169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.760077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.760499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.760916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/5d50090e8a924a76b634807f00734c39/roles/5eccce55b58240518ac72cc9196cb20d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.763273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=5d50090e8a924a76b634807f00734c39, role_id=5eccce55b58240518ac72cc9196cb20d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.764871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.783132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.783409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 540/1078] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:28 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/5d50090e8a924a76b634807f00734c39/roles/5eccce55b58240518ac72cc9196cb20d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:28.783772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.784053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.784431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] PATH_INFO: `/v3/users/0137fd6d4660462d8d46a2380fa5aeaa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.785586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] RBAC: Authorizing `identity:get_user(user_id=0137fd6d4660462d8d46a2380fa5aeaa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.787102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.788943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 539/1079] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/users/0137fd6d4660462d8d46a2380fa5aeaa => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.808044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.870579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.916628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.929394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a306c-fd68-4ee5-bee6-d5f947797e96 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.969960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.970693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.970974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.971244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.972352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] RBAC: Authorizing `identity:get_project(project_id=73366a6a3ed640f4bfc83841d046ce8e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.973785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.980196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 541/1080] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.981577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.022636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.035645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6734b08-35d1-440e-9725-73aa45f227fb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.072441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.073124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.073398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.073662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.084308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccac1be-26d6-4cc6-be73-d34e87364b01 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.098216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.120933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.121604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.121912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.122188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e/users/0137fd6d4660462d8d46a2380fa5aeaa/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.125896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] RBAC: Authorizing `identity:create_grant(project_id=73366a6a3ed640f4bfc83841d046ce8e, user_id=0137fd6d4660462d8d46a2380fa5aeaa, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.126440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.143050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 542/1081] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:28 2022] PUT /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e/users/0137fd6d4660462d8d46a2380fa5aeaa/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:07:29.147435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.148911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.250322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.265899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 540/1082] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:29.269704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.370536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aebbf-2a64-4a9e-95f7-c354b30a48dc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.405349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.405936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.406214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.406486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.417016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.418535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-82f50f1c-666f-4054-bad0-5069e939f4e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:29.433965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:29.435007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:29.435907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:29.435907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:29.435907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:29.435907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 543/1083] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:29.442131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.539651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb9c0-0fdf-412d-b115-3c6794a42ca6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.573353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.573978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.574256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.574528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.575163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.575461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.576818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e997157-b2ce-46ec-b9a2-09b896b3ae97 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.591908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 541/1084] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.703355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8644-554b-4136-94a9-048396b62458 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.703908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8644-554b-4136-94a9-048396b62458 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.703908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8644-554b-4136-94a9-048396b62458 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.705240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 544/1085] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:30.711004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3cb09-18df-4bae-9a94-1580928fa170 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.711404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3cb09-18df-4bae-9a94-1580928fa170 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.711663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3cb09-18df-4bae-9a94-1580928fa170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.730104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c8e3cb09-18df-4bae-9a94-1580928fa170 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:30.731283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c8e3cb09-18df-4bae-9a94-1580928fa170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:30.775915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.796869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 542/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:31.044515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307be41-0ec9-4d05-ae78-7f0d6ac6ee41 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.044794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307be41-0ec9-4d05-ae78-7f0d6ac6ee41 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.045065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307be41-0ec9-4d05-ae78-7f0d6ac6ee41 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.046433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 545/1087] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:31.052164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.052448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.052717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.069182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307be41-0ec9-4d05-ae78-7f0d6ac6ee41 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.070858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:31.072038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:31.096152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.138294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 543/1088] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:31.171546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307be41-0ec9-4d05-ae78-7f0d6ac6ee41 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.203539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.204150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.204420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.204684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.215169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:31.220780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.222403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:07:31.223461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:31.225990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 546/1089] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:31.228520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.325054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6bfeb-639f-4e21-afc1-95a14cb82482 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.335903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.360113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.360708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.360987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.361258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.361936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.362267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.363626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.371296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 544/1090] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:31.376848 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.402383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.464666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.482150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e681b9c-9939-40e7-a727-87aaec75d0f9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.499825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9512-a9c2-41c4-8866-7a24608a5bd6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.514461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.515081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.515356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.515621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.526329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.527759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.532574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.533197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.533475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.533747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:31.541978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.542937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:31.543874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:31.543874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:31.543874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:31.543874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 547/1091] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:31.545159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:31.548797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:31.549962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.550939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:31.551875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 545/1092] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:31.556854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.586771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.649541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607545-7d02-4c04-a184-cc34d13b9f0e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.656108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38878d13-3d26-4b93-be49-1ff7bc2e2158 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.682073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.682667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.682940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.683207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.683840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.684134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.685492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.689720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.690846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.691125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.691396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.692046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.692350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.692696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.693804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.698283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 548/1093] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:31.702556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 546/1094] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:31.703785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.708649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.800345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.807769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0dfb-e799-4d25-a54c-fe0c45802096 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.812876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16635d7d-bc17-4756-b736-bee6c843d071 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.843253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.843803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.844082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.844356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] PATH_INFO: `/v3/users/0137fd6d4660462d8d46a2380fa5aeaa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.845478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] RBAC: Authorizing `identity:get_user(user_id=0137fd6d4660462d8d46a2380fa5aeaa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.847036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.847792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.848487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.848596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/users/0137fd6d4660462d8d46a2380fa5aeaa => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:31.848781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.849082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.854395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.857338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.858823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:31.870870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.871821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:31.873125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 549/1096] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:31.877510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.938940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.962448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34626-5f09-4f09-809b-403f567088f7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.984138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383057e-deeb-44db-b449-95fee9150f63 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.995474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.996068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.996341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.996609 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.020817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.021424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.021701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.022012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.022765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.023249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.024690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.033246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.044122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 550/1097] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:32.051134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.076664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.078155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.162942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7e08-ba4e-4251-9ef0-f4d93715c898 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.178771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.179562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 548/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:32.186046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.205377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.206528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.206791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.207067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.244725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.273308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.274856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.282872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283099-847e-4dae-8a11-963f5233b525 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.317530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.318198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.318477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.318749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.319868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] RBAC: Authorizing `identity:get_project(project_id=73366a6a3ed640f4bfc83841d046ce8e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.321299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.322950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 549/1099] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:32.328992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.372186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 551/1100] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:32.378347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.395790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.432235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef1e3-8536-4ba5-801f-e5ec8f748258 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.464025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.471441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.472058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.472405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.472581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.473311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=73366a6a3ed640f4bfc83841d046ce8e, user.id=0137fd6d4660462d8d46a2380fa5aeaa) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.473613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.475085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.480753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 550/1101] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/role_assignments?user.id=0137fd6d4660462d8d46a2380fa5aeaa&scope.project.id=73366a6a3ed640f4bfc83841d046ce8e&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:32.487393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37978a1b-1f6b-4299-8277-a397d20a2790 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.524959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.525618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.525927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.526201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.537466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.538969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:32.555903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:32.557215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:32.558411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:32.558411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:32.558411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:32.558411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 552/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:32.562986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.667643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df5ae-5f48-4e92-8749-c9eec88a96c4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.701475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.702033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.702311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.702580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.703211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.703511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.704869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.716874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 551/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.722770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.788941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.824017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204645d-0a66-48bf-a9ca-daba569bf672 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.860333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.861074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.861382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.861720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.872892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.874380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:32.886718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:32.887706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:32.888604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 553/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:32.893653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.950910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.995992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8c84b-d384-4f74-9580-5c5a1fda5818 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.030509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.031107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.031382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.031651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.032338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.032641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.034122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff1e0-c474-461a-a923-3e759dee2329 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.045607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 552/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.052575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.150291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786e961-8a3f-4c73-8fe4-dae67e48d0c6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.175927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.183692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.184302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.184825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.185249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.186301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] RBAC: Adding query filter params (role.id=5eccce55b58240518ac72cc9196cb20d, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=5d50090e8a924a76b634807f00734c39) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.186609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.188029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad142fd6-e82a-454e-b8c2-19ef087e0ef2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.193581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 554/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/role_assignments?user.id=5d50090e8a924a76b634807f00734c39&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=5eccce55b58240518ac72cc9196cb20d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:34.431778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7969034-ab34-46c4-883a-77b6869f7f50 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.432334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7969034-ab34-46c4-883a-77b6869f7f50 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.432334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7969034-ab34-46c4-883a-77b6869f7f50 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.433643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 553/1107] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:34.438968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.439392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.439530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.458009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:34.459199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:34.523884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:34.793014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7969034-ab34-46c4-883a-77b6869f7f50 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.894943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7969034-ab34-46c4-883a-77b6869f7f50 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.907911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.927686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425fb0b-fcb5-4efe-96ca-cceaa25724f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.928305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425fb0b-fcb5-4efe-96ca-cceaa25724f6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.928585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425fb0b-fcb5-4efe-96ca-cceaa25724f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.928856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425fb0b-fcb5-4efe-96ca-cceaa25724f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.930247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425fb0b-fcb5-4efe-96ca-cceaa25724f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.931667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425fb0b-fcb5-4efe-96ca-cceaa25724f6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.933238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:34.939057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.045117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65b7bf-a973-4e6b-b03e-8c37d6d84f6e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.071376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.083082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5bd0e-eab8-40c8-8f8f-7ee962d48374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.083690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5bd0e-eab8-40c8-8f8f-7ee962d48374 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.083972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5bd0e-eab8-40c8-8f8f-7ee962d48374 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.084246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5bd0e-eab8-40c8-8f8f-7ee962d48374 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.084900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5bd0e-eab8-40c8-8f8f-7ee962d48374 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.086365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5bd0e-eab8-40c8-8f8f-7ee962d48374 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.106879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:34 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:37.039391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c28c43-be65-42a9-9cde-f342b88acee2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.039918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c28c43-be65-42a9-9cde-f342b88acee2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.039918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c28c43-be65-42a9-9cde-f342b88acee2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.041246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 555/1111] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:37.046460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.046827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.047008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.065796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:37.067005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:37.135429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:37.406000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c28c43-be65-42a9-9cde-f342b88acee2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.503800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c28c43-be65-42a9-9cde-f342b88acee2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.535856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.536952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.537224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.537492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] PATH_INFO: `/v3/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.538874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] RBAC: Authorizing `identity:get_role(role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.540225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.541517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/roles/0c368ffea6f0432c889772bf6f846afe => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.547232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.642819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca76a2-c7f4-47d1-b70b-a692f0ee304b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.652252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.677351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.677937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.678221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.678495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] PATH_INFO: `/v3/users/3aedde6a87ac45ce9a8126c61b228a43` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.691937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] RBAC: Authorizing `identity:get_user(user_id=3aedde6a87ac45ce9a8126c61b228a43)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.693383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.695043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/users/3aedde6a87ac45ce9a8126c61b228a43 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.704687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.755138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.805701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3a2d-9490-417d-b6d2-20bbe3429678 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.844426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.845033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.845312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.845585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.922818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.924282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.972038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.026275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:38.032259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.131967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024df50-7ba9-4255-805e-03f02be12f0e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.173737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca336e48-7cda-47bd-aa47-ed0aca5664dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.174978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336e48-7cda-47bd-aa47-ed0aca5664dd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.175258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336e48-7cda-47bd-aa47-ed0aca5664dd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.175532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336e48-7cda-47bd-aa47-ed0aca5664dd None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.176653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca336e48-7cda-47bd-aa47-ed0aca5664dd None admin] RBAC: Authorizing `identity:get_project(project_id=73366a6a3ed640f4bfc83841d046ce8e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.178126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca336e48-7cda-47bd-aa47-ed0aca5664dd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.179762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:38.186259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.285117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d35c1-6f7f-45f7-bdc4-048fab304a77 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.319812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.320409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.320688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.320961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.321681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] RBAC: Adding query filter params (role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=73366a6a3ed640f4bfc83841d046ce8e, user.id=3aedde6a87ac45ce9a8126c61b228a43) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:38.322021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.323459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c2a9-49db-48d2-8bcc-9092f9d4cd7d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.328627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/role_assignments?user.id=3aedde6a87ac45ce9a8126c61b228a43&scope.project.id=73366a6a3ed640f4bfc83841d046ce8e&role.id=0c368ffea6f0432c889772bf6f846afe => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.205395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906e3e9-398a-42be-ad37-4b7755dc3ddf None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.205913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906e3e9-398a-42be-ad37-4b7755dc3ddf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.205913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906e3e9-398a-42be-ad37-4b7755dc3ddf None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.207222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:40.212175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.212586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.212709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.230923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:40.232112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:40.241833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.298264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:40.560520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906e3e9-398a-42be-ad37-4b7755dc3ddf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.594840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.660268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906e3e9-398a-42be-ad37-4b7755dc3ddf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.693563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.694198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.694477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.694748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] PATH_INFO: `/v3/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.696112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] RBAC: Authorizing `identity:get_role(role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.697477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.698799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/roles/0c368ffea6f0432c889772bf6f846afe => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.704679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.798417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95101-2a60-4cba-97f5-598bc31a84a8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.830464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.831022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.831294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.831559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] PATH_INFO: `/v3/users/3aedde6a87ac45ce9a8126c61b228a43` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.832669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] RBAC: Authorizing `identity:get_user(user_id=3aedde6a87ac45ce9a8126c61b228a43)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.834109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.835630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/users/3aedde6a87ac45ce9a8126c61b228a43 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.841266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.938232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a697730-8aec-4a82-9063-22a102b981d6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.939755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.972189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9abc1-515e-4acd-83e8-2d76dfa038b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.972810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9abc1-515e-4acd-83e8-2d76dfa038b5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.973090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9abc1-515e-4acd-83e8-2d76dfa038b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.973363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9abc1-515e-4acd-83e8-2d76dfa038b5 None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.974484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9abc1-515e-4acd-83e8-2d76dfa038b5 None admin] RBAC: Authorizing `identity:get_project(project_id=73366a6a3ed640f4bfc83841d046ce8e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.975912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9abc1-515e-4acd-83e8-2d76dfa038b5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.977528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.983427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.998284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.079961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb99d6-7d3d-4139-a07b-bd3a0fcd4040 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.113025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04648b22-b0c5-46cb-ae40-aca26285764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.113602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648b22-b0c5-46cb-ae40-aca26285764f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.113905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648b22-b0c5-46cb-ae40-aca26285764f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.114182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648b22-b0c5-46cb-ae40-aca26285764f None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e/users/3aedde6a87ac45ce9a8126c61b228a43/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.116295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04648b22-b0c5-46cb-ae40-aca26285764f None admin] RBAC: Authorizing `identity:create_grant(project_id=73366a6a3ed640f4bfc83841d046ce8e, user_id=3aedde6a87ac45ce9a8126c61b228a43, role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.117717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04648b22-b0c5-46cb-ae40-aca26285764f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.129614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:40 2022] PUT /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e/users/3aedde6a87ac45ce9a8126c61b228a43/roles/0c368ffea6f0432c889772bf6f846afe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:43.015095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc4dc-9be8-48cb-af62-65fc90edaeec None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.015654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc4dc-9be8-48cb-af62-65fc90edaeec None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.015654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc4dc-9be8-48cb-af62-65fc90edaeec None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.016945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:43.022528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.022972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.023073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.040586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:43.041757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:43.105195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:43.368661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc4dc-9be8-48cb-af62-65fc90edaeec None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.466477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc4dc-9be8-48cb-af62-65fc90edaeec None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.498406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.499013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.499285 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.499552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] PATH_INFO: `/v3/roles/0c368ffea6f0432c889772bf6f846afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.500886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] RBAC: Authorizing `identity:get_role(role_id=0c368ffea6f0432c889772bf6f846afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.502271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.503559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/roles/0c368ffea6f0432c889772bf6f846afe => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:43.509281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.511448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.604925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49bddd-60da-44cf-bcd4-fad4d9a0cdbc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.636975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.637526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.637800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.638102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] PATH_INFO: `/v3/users/3aedde6a87ac45ce9a8126c61b228a43` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.639202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] RBAC: Authorizing `identity:get_user(user_id=3aedde6a87ac45ce9a8126c61b228a43)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.640619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.642191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/users/3aedde6a87ac45ce9a8126c61b228a43 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:43.648353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.686839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.744819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bec5-a3fe-44fc-afbc-c53d6968aa73 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.778215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.778805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.779083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.779356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.843721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.845151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.885596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.946466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:43.952359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.019637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:44.049838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df102499-76c4-4e1c-a77a-7d5770441198 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.083380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508caed-8d29-49c1-a35c-770ba3505f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.083995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508caed-8d29-49c1-a35c-770ba3505f36 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.084272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508caed-8d29-49c1-a35c-770ba3505f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.084541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508caed-8d29-49c1-a35c-770ba3505f36 None admin] PATH_INFO: `/v3/projects/73366a6a3ed640f4bfc83841d046ce8e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.085633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508caed-8d29-49c1-a35c-770ba3505f36 None admin] RBAC: Authorizing `identity:get_project(project_id=73366a6a3ed640f4bfc83841d046ce8e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.087098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508caed-8d29-49c1-a35c-770ba3505f36 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.088689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/projects/73366a6a3ed640f4bfc83841d046ce8e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:44.094829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.189895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f38da-1080-4f2c-a597-bd80fa13e0cd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.224133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123265-1e08-4c26-882d-ec891845488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.224669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123265-1e08-4c26-882d-ec891845488f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.224944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123265-1e08-4c26-882d-ec891845488f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.225214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123265-1e08-4c26-882d-ec891845488f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.225960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123265-1e08-4c26-882d-ec891845488f None admin] RBAC: Adding query filter params (role.id=0c368ffea6f0432c889772bf6f846afe, scope.project.id=73366a6a3ed640f4bfc83841d046ce8e, user.id=3aedde6a87ac45ce9a8126c61b228a43) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:44.226269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123265-1e08-4c26-882d-ec891845488f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.227694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123265-1e08-4c26-882d-ec891845488f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.233236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:44 2022] GET /identity/v3/role_assignments?user.id=3aedde6a87ac45ce9a8126c61b228a43&scope.project.id=73366a6a3ed640f4bfc83841d046ce8e&role.id=0c368ffea6f0432c889772bf6f846afe => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.135162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe2d34-116f-4b28-8af4-cab9fc7e28d1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.135680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe2d34-116f-4b28-8af4-cab9fc7e28d1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.135680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe2d34-116f-4b28-8af4-cab9fc7e28d1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.137000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:46.142160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.142587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.142749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.148942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.162275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:46.163456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:46.229471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:46.498121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe2d34-116f-4b28-8af4-cab9fc7e28d1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.595534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe2d34-116f-4b28-8af4-cab9fc7e28d1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.628799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa01460-d0fb-4a94-8da0-e85d33fb124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.629406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa01460-d0fb-4a94-8da0-e85d33fb124e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.629677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa01460-d0fb-4a94-8da0-e85d33fb124e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.629975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa01460-d0fb-4a94-8da0-e85d33fb124e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.631058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa01460-d0fb-4a94-8da0-e85d33fb124e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.632468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa01460-d0fb-4a94-8da0-e85d33fb124e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.634024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.639785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.734456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e88b18-ce96-451d-8259-99013dfbd310 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.762783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.768410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4ff2e-c1d9-4a08-86e6-081adfc5bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.769004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ff2e-c1d9-4a08-86e6-081adfc5bf52 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.769276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ff2e-c1d9-4a08-86e6-081adfc5bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.769542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4ff2e-c1d9-4a08-86e6-081adfc5bf52 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.770223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4ff2e-c1d9-4a08-86e6-081adfc5bf52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.771631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4ff2e-c1d9-4a08-86e6-081adfc5bf52 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.797589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:46 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:48.700976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0542c-9eba-45c9-bcb1-7937d26566f8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.701505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0542c-9eba-45c9-bcb1-7937d26566f8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.701505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0542c-9eba-45c9-bcb1-7937d26566f8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.702892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:48.708021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.708450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.708567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.726081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:48.727233 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:48.790149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:49.060165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0542c-9eba-45c9-bcb1-7937d26566f8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.069415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.158858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0542c-9eba-45c9-bcb1-7937d26566f8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.191781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1205d-cbf4-4303-8116-7d2f6c267e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.192388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1205d-cbf4-4303-8116-7d2f6c267e18 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.192667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1205d-cbf4-4303-8116-7d2f6c267e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.192938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1205d-cbf4-4303-8116-7d2f6c267e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.194061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1205d-cbf4-4303-8116-7d2f6c267e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.195492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1205d-cbf4-4303-8116-7d2f6c267e18 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.197027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.202621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.296081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf0bb-a8c0-4e21-b1ce-a72268d3da1a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.309995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.329754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8b93d-a293-4bd1-934c-2ce5a4dd1c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.330841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b93d-a293-4bd1-934c-2ce5a4dd1c5a None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.331113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b93d-a293-4bd1-934c-2ce5a4dd1c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.331380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b93d-a293-4bd1-934c-2ce5a4dd1c5a None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.332016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8b93d-a293-4bd1-934c-2ce5a4dd1c5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.333429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8b93d-a293-4bd1-934c-2ce5a4dd1c5a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.353365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:49 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:51.284370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c4d3-100d-4e7d-bfca-399a5573b4da None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.284895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c4d3-100d-4e7d-bfca-399a5573b4da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.284895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c4d3-100d-4e7d-bfca-399a5573b4da None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.286263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:51.291544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.291946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.292088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.309978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:51.311128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:51.377528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:51.644282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7c4d3-100d-4e7d-bfca-399a5573b4da None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.724092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.749215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7c4d3-100d-4e7d-bfca-399a5573b4da None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.781094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.781700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.782003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.782271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.791803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:51.796478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:51.797661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:51.799286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:51.804064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.896599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.899792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a55d1-6f35-4d25-9cd8-5ffdb48527c7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.934360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.934948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.935220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.935485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.936132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:51.936424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.937810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.945539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.951419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.046500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153143c6-53d2-4b64-9931-6edd40da21ff None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.078715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.079319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.079597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.079868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] PATH_INFO: `/v3/users/84084585139a40aa9e65b39d0a773ecc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.082212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.094162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] RBAC: Authorizing `identity:get_user(user_id=84084585139a40aa9e65b39d0a773ecc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.095626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.097256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/users/84084585139a40aa9e65b39d0a773ecc => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.103142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.197760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008319d4-c5f4-40aa-a9d1-9a9a39b5c4f7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.229167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.229746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.230049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.230317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.258802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.295712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.297145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.388838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:52.395271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.490455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ceaee-df14-4d96-a870-18d1defbeba5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.522720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331e14a-e37b-46bb-b4f2-6c9631da7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.523329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331e14a-e37b-46bb-b4f2-6c9631da7d77 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.523604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331e14a-e37b-46bb-b4f2-6c9631da7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.523872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331e14a-e37b-46bb-b4f2-6c9631da7d77 None admin] PATH_INFO: `/v3/projects/75744e88ff0643e884471f3cd16d13dc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.524967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331e14a-e37b-46bb-b4f2-6c9631da7d77 None admin] RBAC: Authorizing `identity:get_project(project_id=75744e88ff0643e884471f3cd16d13dc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.526417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331e14a-e37b-46bb-b4f2-6c9631da7d77 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.528016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/projects/75744e88ff0643e884471f3cd16d13dc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.534604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.593242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.630246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8a34-7223-4737-bd5e-dcc2ffdf4c8a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.662149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.662732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.663003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.663269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.663973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=75744e88ff0643e884471f3cd16d13dc, user.id=84084585139a40aa9e65b39d0a773ecc) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:52.664274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.665682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc07aa8-ba8b-42e0-b835-09a1baf4d84d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.670797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/role_assignments?user.id=84084585139a40aa9e65b39d0a773ecc&scope.project.id=75744e88ff0643e884471f3cd16d13dc&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:54.538655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc3c32-f384-4baf-b356-02bd18c789ba None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.539202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc3c32-f384-4baf-b356-02bd18c789ba None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.539202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc3c32-f384-4baf-b356-02bd18c789ba None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.540513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:54.545723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.546164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.546299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.565187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:54.566386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:54.629646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:54.894829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc3c32-f384-4baf-b356-02bd18c789ba None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.953173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.992998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc3c32-f384-4baf-b356-02bd18c789ba None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.025955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.026559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.026835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.027101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.037212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:55.042010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:55.043107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:07:55.044126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:55.048952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.103085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.144840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85684d-353a-44fc-a84a-bcb2f460759f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.177559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.178175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.178451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.178720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.179369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:55.179926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.181276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.188962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.195104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.289683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7f9f9-d746-4229-ae48-4211c79593b0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.308716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.322641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.323243 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.323519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.323788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] PATH_INFO: `/v3/users/84084585139a40aa9e65b39d0a773ecc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.324876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] RBAC: Authorizing `identity:get_user(user_id=84084585139a40aa9e65b39d0a773ecc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.326397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.327930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/users/84084585139a40aa9e65b39d0a773ecc => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.334167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.428085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2afee4-b572-4edd-8ea3-614e57990ad2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.444195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.460937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e24a-0ddf-4336-8dba-4e8cad0dae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.461544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e24a-0ddf-4336-8dba-4e8cad0dae65 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.461820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e24a-0ddf-4336-8dba-4e8cad0dae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.462120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e24a-0ddf-4336-8dba-4e8cad0dae65 None admin] PATH_INFO: `/v3/projects/75744e88ff0643e884471f3cd16d13dc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.463213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e24a-0ddf-4336-8dba-4e8cad0dae65 None admin] RBAC: Authorizing `identity:get_project(project_id=75744e88ff0643e884471f3cd16d13dc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.464625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e24a-0ddf-4336-8dba-4e8cad0dae65 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.466247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/projects/75744e88ff0643e884471f3cd16d13dc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.472539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.568126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4376d-3f44-4bec-8f9f-9b0744e694b8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.599664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38a3f-12a2-4cae-901d-adf2544e9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.600292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38a3f-12a2-4cae-901d-adf2544e9eef None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.600568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38a3f-12a2-4cae-901d-adf2544e9eef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.600838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38a3f-12a2-4cae-901d-adf2544e9eef None admin] PATH_INFO: `/v3/projects/75744e88ff0643e884471f3cd16d13dc/users/84084585139a40aa9e65b39d0a773ecc/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.602728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d38a3f-12a2-4cae-901d-adf2544e9eef None admin] RBAC: Authorizing `identity:create_grant(project_id=75744e88ff0643e884471f3cd16d13dc, user_id=84084585139a40aa9e65b39d0a773ecc, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.604135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d38a3f-12a2-4cae-901d-adf2544e9eef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.617567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:55 2022] PUT /identity/v3/projects/75744e88ff0643e884471f3cd16d13dc/users/84084585139a40aa9e65b39d0a773ecc/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:57.475104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0364941-5949-4467-b757-b591b04252f7 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.475646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0364941-5949-4467-b757-b591b04252f7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.475646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0364941-5949-4467-b757-b591b04252f7 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.476999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:57.482258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.482676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.482802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.500967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:57.502788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:57.543660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.568777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:57.841777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0364941-5949-4467-b757-b591b04252f7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.940776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0364941-5949-4467-b757-b591b04252f7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.972864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.973479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.973755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.974053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.984134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:57.989456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:57.990588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:07:57.991447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:57.996591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.090920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6bed-17ad-4d09-8583-f3dffff5a109 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.125507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.125947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.126230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.126501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.127158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.127459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.128817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.136941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.142837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.188251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.240484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978377f-7d06-411f-8998-8a46fea66f82 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.272227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.272837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.273115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.273387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] PATH_INFO: `/v3/users/84084585139a40aa9e65b39d0a773ecc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.274496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] RBAC: Authorizing `identity:get_user(user_id=84084585139a40aa9e65b39d0a773ecc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.275928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.277485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/users/84084585139a40aa9e65b39d0a773ecc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.283908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.324129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.379806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066092d-011b-4b43-9f3c-71b2ad2501c4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.413002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.413593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.413886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.414160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.479575 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.481009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.519341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.574825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:58.581178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.677243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b824-e466-4f37-a738-2e4943862816 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.690385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.709690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a896a-9786-4bf4-a99d-0c2f96f24943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.710328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a896a-9786-4bf4-a99d-0c2f96f24943 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.710607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a896a-9786-4bf4-a99d-0c2f96f24943 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.710879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a896a-9786-4bf4-a99d-0c2f96f24943 None admin] PATH_INFO: `/v3/projects/75744e88ff0643e884471f3cd16d13dc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.711972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a896a-9786-4bf4-a99d-0c2f96f24943 None admin] RBAC: Authorizing `identity:get_project(project_id=75744e88ff0643e884471f3cd16d13dc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.713405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a896a-9786-4bf4-a99d-0c2f96f24943 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.715036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/projects/75744e88ff0643e884471f3cd16d13dc => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.721449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.814713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dada-5ba8-4d7e-aec1-675cb307cff5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.846888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.847469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.847745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.848013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.848724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=75744e88ff0643e884471f3cd16d13dc, user.id=84084585139a40aa9e65b39d0a773ecc) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.849029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.850477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d9d45-b34c-4c48-9e30-65f49ce9c777 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.855966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/role_assignments?user.id=84084585139a40aa9e65b39d0a773ecc&scope.project.id=75744e88ff0643e884471f3cd16d13dc&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:00.758566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603a43-781d-4cff-aaa4-4f533ab2d33f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.759294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603a43-781d-4cff-aaa4-4f533ab2d33f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.759582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603a43-781d-4cff-aaa4-4f533ab2d33f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.761033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:00.766106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.766533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.766639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.774263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:00.785530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:00.786741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:00.849939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:01.112464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603a43-781d-4cff-aaa4-4f533ab2d33f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.212449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603a43-781d-4cff-aaa4-4f533ab2d33f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.244441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.245030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.245308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.245582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.291903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.310422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.311859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.404874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:01.410751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.503605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd98cb1-668e-4d6f-b81c-edafa53b4b4c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.535659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.536263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.536541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.536808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.538640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.544056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.545664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3aad2b17-b629-4cb0-91c2-75f3a02bd06c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:01.557506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:01.558779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:08:01.559784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:01.564994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.642601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.660541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b626c-b424-48ed-a9c7-066a8a507269 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.693088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.693672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.693978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.694254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.694881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:01.695181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.696536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512228c-4056-4174-b5c9-aa1da420d547 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.703377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:03.594677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554b91-7cb0-4c0f-a61f-8cd14c144cbd None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.595237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554b91-7cb0-4c0f-a61f-8cd14c144cbd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.595237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554b91-7cb0-4c0f-a61f-8cd14c144cbd None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.596552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:03.601598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06204a7-f313-4fe8-9e3e-39cf5ae37bf4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.602021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06204a7-f313-4fe8-9e3e-39cf5ae37bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.602177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06204a7-f313-4fe8-9e3e-39cf5ae37bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.620301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b06204a7-f313-4fe8-9e3e-39cf5ae37bf4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:03.621476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b06204a7-f313-4fe8-9e3e-39cf5ae37bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:03.685573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:03.954892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554b91-7cb0-4c0f-a61f-8cd14c144cbd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:04.052193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554b91-7cb0-4c0f-a61f-8cd14c144cbd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:04.084726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12021e08-1cab-49db-9e74-5f67fb9fabdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:04.085317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021e08-1cab-49db-9e74-5f67fb9fabdf None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.085593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021e08-1cab-49db-9e74-5f67fb9fabdf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.085886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021e08-1cab-49db-9e74-5f67fb9fabdf None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.086558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12021e08-1cab-49db-9e74-5f67fb9fabdf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:04.087919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12021e08-1cab-49db-9e74-5f67fb9fabdf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:04.103182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed Aug 31 00:08:03 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:05.991160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54cef0-a843-4245-ac96-9f0d233c4e46 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.991690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54cef0-a843-4245-ac96-9f0d233c4e46 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.991690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54cef0-a843-4245-ac96-9f0d233c4e46 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.993033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:05.998044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.998439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.998588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.016722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:06.017989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:06.066426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.083956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:06.363449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54cef0-a843-4245-ac96-9f0d233c4e46 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.444730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.467986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54cef0-a843-4245-ac96-9f0d233c4e46 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.500456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2dd11-665a-4a2e-8db7-c19644c4ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.501158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2dd11-665a-4a2e-8db7-c19644c4ba03 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.501957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2dd11-665a-4a2e-8db7-c19644c4ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.502232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2dd11-665a-4a2e-8db7-c19644c4ba03 None admin] PATH_INFO: `/v3/domains/e7206b7fddc14b2080b0d89c7aee947b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.512182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2dd11-665a-4a2e-8db7-c19644c4ba03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e7206b7fddc14b2080b0d89c7aee947b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.513622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2dd11-665a-4a2e-8db7-c19644c4ba03 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.515215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains/e7206b7fddc14b2080b0d89c7aee947b => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:06.521025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.616266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dcaac-62ea-44e4-897d-17a4435272f8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.649327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317c45c-828a-4893-82fc-85a03bc4125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.649955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c45c-828a-4893-82fc-85a03bc4125c None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.650232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c45c-828a-4893-82fc-85a03bc4125c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.650499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317c45c-828a-4893-82fc-85a03bc4125c None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.651149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317c45c-828a-4893-82fc-85a03bc4125c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.652562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317c45c-828a-4893-82fc-85a03bc4125c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.678598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:06 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:08.593333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29cf1-6531-4038-8d4d-38cc38188077 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.593913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29cf1-6531-4038-8d4d-38cc38188077 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.593913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29cf1-6531-4038-8d4d-38cc38188077 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.595732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:08.600887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.601279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.601420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.619865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:08.621047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:08.648169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.685996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:08.953360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29cf1-6531-4038-8d4d-38cc38188077 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.050571 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29cf1-6531-4038-8d4d-38cc38188077 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.082385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade35f1e-c815-4b8e-b811-3d5b93d041f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.082990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade35f1e-c815-4b8e-b811-3d5b93d041f8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.083261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade35f1e-c815-4b8e-b811-3d5b93d041f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.083527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade35f1e-c815-4b8e-b811-3d5b93d041f8 None admin] PATH_INFO: `/v3/domains/e7206b7fddc14b2080b0d89c7aee947b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.084608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade35f1e-c815-4b8e-b811-3d5b93d041f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e7206b7fddc14b2080b0d89c7aee947b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.086112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade35f1e-c815-4b8e-b811-3d5b93d041f8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.087654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/domains/e7206b7fddc14b2080b0d89c7aee947b => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:09.093264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.187591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba0e4-75e5-4383-95b8-8027090c3960 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.219271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2515f3-e71c-4a02-8256-3913bf814361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.220366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2515f3-e71c-4a02-8256-3913bf814361 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.220639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2515f3-e71c-4a02-8256-3913bf814361 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.220908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2515f3-e71c-4a02-8256-3913bf814361 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.221554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2515f3-e71c-4a02-8256-3913bf814361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.223010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2515f3-e71c-4a02-8256-3913bf814361 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.242990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:09 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:11.164536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9da1d-79f3-4e07-88d5-b7314a81340e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.165052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9da1d-79f3-4e07-88d5-b7314a81340e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.165052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9da1d-79f3-4e07-88d5-b7314a81340e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.166384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:11.171371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.171733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.171916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.190832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:11.192009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:11.207990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.257785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:11.523570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9da1d-79f3-4e07-88d5-b7314a81340e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.527441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.622941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9da1d-79f3-4e07-88d5-b7314a81340e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.655486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.656096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.656375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.656644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.666805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:11.671553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.672660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:08:11.673713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:11.678607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.773353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346230c-5d4c-4ddd-b703-7c7d972a207f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.806010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.806525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.806800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.807067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.807725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.808026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.809381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.817091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:11.822787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.882738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.920659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0356-e2e5-4256-b219-fd9e939c2375 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.952256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.952867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.953143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.953413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] PATH_INFO: `/v3/users/7ae85e26710b40e4951d5b977a110bd7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.966294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=7ae85e26710b40e4951d5b977a110bd7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.967724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.969301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/users/7ae85e26710b40e4951d5b977a110bd7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:11.975824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.991367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.072363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe57e7-d76a-4f8c-ad0b-ca2fd9894f72 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.104685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.105272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.105550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.105822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.169562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.171036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.184709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.265023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:12.271440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.366549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07351e80-2aea-4587-9705-40deb7dfc0b3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.387644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.398886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61cba3-1734-48bb-b0df-d7f9708b189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.399496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61cba3-1734-48bb-b0df-d7f9708b189e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.399768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61cba3-1734-48bb-b0df-d7f9708b189e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.400031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61cba3-1734-48bb-b0df-d7f9708b189e None admin] PATH_INFO: `/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.401105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61cba3-1734-48bb-b0df-d7f9708b189e None admin] RBAC: Authorizing `identity:get_project(project_id=7021b11c10cb43f0807ef24c9fcb62fe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.402541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61cba3-1734-48bb-b0df-d7f9708b189e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.404127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.410821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.507700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc65e6-9b96-4011-a21a-ac3b25a5e9ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.521390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.541298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.541915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.542192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.542458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.543175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=7021b11c10cb43f0807ef24c9fcb62fe, user.id=7ae85e26710b40e4951d5b977a110bd7) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.543474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.544882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793968f2-c7df-4c2b-b86b-95622e53a475 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.550044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/role_assignments?user.id=7ae85e26710b40e4951d5b977a110bd7&scope.project.id=7021b11c10cb43f0807ef24c9fcb62fe&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.451907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330e24-3c49-431d-8d7d-2e9978aff6fc None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.452517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330e24-3c49-431d-8d7d-2e9978aff6fc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.452517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86330e24-3c49-431d-8d7d-2e9978aff6fc None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.453768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:14.459553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.459988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.460103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.477711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:14.478931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:14.542946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:14.808184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86330e24-3c49-431d-8d7d-2e9978aff6fc None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.905610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86330e24-3c49-431d-8d7d-2e9978aff6fc None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.938853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.939463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.939737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.940006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.949733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:14.954531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.955718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:08:14.956823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.961562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.057265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a2a5a-bb7e-413c-941e-9b6b85977e34 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.066706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.091392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.091980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.092260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.092534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.093187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:15.093489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.095453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.103474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:15.109299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.159033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.207483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56a916-bf79-452e-9501-5c0c56f1154a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.239936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.240538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.240819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.241088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] PATH_INFO: `/v3/users/7ae85e26710b40e4951d5b977a110bd7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.242203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7ae85e26710b40e4951d5b977a110bd7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.243622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.245156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/users/7ae85e26710b40e4951d5b977a110bd7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:15.251397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.347030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468989e9-6d44-4d06-936a-fa628cda6ab6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.378844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5d0b-dd92-4f0e-98a9-2ebb3bc324e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.379455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5d0b-dd92-4f0e-98a9-2ebb3bc324e9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.379735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5d0b-dd92-4f0e-98a9-2ebb3bc324e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.380010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5d0b-dd92-4f0e-98a9-2ebb3bc324e9 None admin] PATH_INFO: `/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.381119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5d0b-dd92-4f0e-98a9-2ebb3bc324e9 None admin] RBAC: Authorizing `identity:get_project(project_id=7021b11c10cb43f0807ef24c9fcb62fe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.383126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5d0b-dd92-4f0e-98a9-2ebb3bc324e9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.388152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:15.394516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.489708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd2cd1-6ed5-47e6-83e1-de9b562c23e3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.506566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.523449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdac3-493c-41be-8412-a2f5855e6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.524092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdac3-493c-41be-8412-a2f5855e6953 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.524371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdac3-493c-41be-8412-a2f5855e6953 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.524646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdac3-493c-41be-8412-a2f5855e6953 None admin] PATH_INFO: `/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe/users/7ae85e26710b40e4951d5b977a110bd7/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.526678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdac3-493c-41be-8412-a2f5855e6953 None admin] RBAC: Authorizing `identity:create_grant(project_id=7021b11c10cb43f0807ef24c9fcb62fe, user_id=7ae85e26710b40e4951d5b977a110bd7, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.528112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdac3-493c-41be-8412-a2f5855e6953 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.539958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:15 2022] PUT /identity/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe/users/7ae85e26710b40e4951d5b977a110bd7/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:17.399193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f0cc-0e3b-4546-9b8d-732ba105f6d0 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.399734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f0cc-0e3b-4546-9b8d-732ba105f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.399734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f0cc-0e3b-4546-9b8d-732ba105f6d0 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.401066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:17.406259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.406657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.407346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.425471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:17.426671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:17.490677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:17.753078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f0cc-0e3b-4546-9b8d-732ba105f6d0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.793978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.852002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f0cc-0e3b-4546-9b8d-732ba105f6d0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.885310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.885963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.886242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.886513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.896655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:17.901415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:17.902406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:08:17.903251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:17.908465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.002216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c5b96-ff75-40d8-beee-5ec137e086e6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.011022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.036083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.036674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.036950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.037222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.037899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.038200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.039572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.047300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.052933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.143918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.147770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690408c-e6ae-4b67-89e4-a6df95437948 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.180867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.181470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.181746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.182043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] PATH_INFO: `/v3/users/7ae85e26710b40e4951d5b977a110bd7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.183137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ae85e26710b40e4951d5b977a110bd7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.184568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.186133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/users/7ae85e26710b40e4951d5b977a110bd7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.191750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.285955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6da92-1a0e-4735-809f-fd59bdc57674 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.318928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.319513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.319790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.320062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.357457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.384968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.386439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.489241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:18.495131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.592350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58819cae-5916-4ec0-90a4-f9f39a6871b1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.624038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed2009-e142-49c1-b8cd-e9ef8508e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.624649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed2009-e142-49c1-b8cd-e9ef8508e810 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.624923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed2009-e142-49c1-b8cd-e9ef8508e810 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.625191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed2009-e142-49c1-b8cd-e9ef8508e810 None admin] PATH_INFO: `/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.626306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed2009-e142-49c1-b8cd-e9ef8508e810 None admin] RBAC: Authorizing `identity:get_project(project_id=7021b11c10cb43f0807ef24c9fcb62fe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.627735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed2009-e142-49c1-b8cd-e9ef8508e810 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.629332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/projects/7021b11c10cb43f0807ef24c9fcb62fe => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.635424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.705476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.739365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898aed8-bdca-4a0b-acc4-07ac83c66ea3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.772779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.773371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.773649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.773945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.774662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=7021b11c10cb43f0807ef24c9fcb62fe, user.id=7ae85e26710b40e4951d5b977a110bd7) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.774968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.776390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608c559-f3bc-4f94-8ae2-5f2c7118038b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.782582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/role_assignments?user.id=7ae85e26710b40e4951d5b977a110bd7&scope.project.id=7021b11c10cb43f0807ef24c9fcb62fe&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:28.619988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.779380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=33 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.717317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b65224-13c0-439f-91d2-5caf848a26f3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.718036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b65224-13c0-439f-91d2-5caf848a26f3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.718036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b65224-13c0-439f-91d2-5caf848a26f3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.719355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:13.725502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.726187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.726187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.747319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:13.748722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:13.847888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:14.121772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b65224-13c0-439f-91d2-5caf848a26f3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.264099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b65224-13c0-439f-91d2-5caf848a26f3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.308020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.308975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.309581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.310267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.323320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.324764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:14.340193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:14.342456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:14.343517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:14.343517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:14.343517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:14.343517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:14.348123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.489197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954df6-be39-4568-9a58-8ffe2afb9ea2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.533396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.543557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.544816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.545167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.545492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.546642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:14.546780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.548623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc122d04-bf6c-4453-9a48-7a0910dcf577 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.567643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:14.574186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.641326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.700373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6c918-9903-43f4-b6e2-1e2f319b5b72 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.738036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109d397-9f80-44c6-bf5b-add75e777908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.738701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d397-9f80-44c6-bf5b-add75e777908 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.738952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d397-9f80-44c6-bf5b-add75e777908 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.739186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d397-9f80-44c6-bf5b-add75e777908 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.739884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109d397-9f80-44c6-bf5b-add75e777908 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.741265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109d397-9f80-44c6-bf5b-add75e777908 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.764979 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 31 00:09:14 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:17.112909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b6cf-342a-4106-a90b-c90dad5d85ad None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.113474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b6cf-342a-4106-a90b-c90dad5d85ad None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.113474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b6cf-342a-4106-a90b-c90dad5d85ad None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.114964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:17.121744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.121744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.121744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.142664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:17.143868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:17.220104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:17.537722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b6cf-342a-4106-a90b-c90dad5d85ad None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.662249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b6cf-342a-4106-a90b-c90dad5d85ad None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.701404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.702628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.702628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.702818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.714281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:17.719842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:17.721007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:09:17.722502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:17.726023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:17.727181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.774171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.838336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5916e-c66e-43eb-9262-0d690b4e8896 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.876865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.877467 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.877741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.878073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.878725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:17.879023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.880389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.888859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:17.894405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.953619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.015356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074819-1d5a-4d06-9f11-e9346dcc1c78 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.058344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.060863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.060863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.060863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.071539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.073159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:18.088680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:18.089802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:18.090763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:18.090763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:18.090763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:18.090763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:18.096376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.208105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.214563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2f41-a99d-4199-bd14-7d2c38d2d49d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.257576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.258248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.258576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.258978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.259543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:18.262465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.262465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.274800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:18.280885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.408029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ccdf6-2b81-4740-87cb-aa29d0b0d3fc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.409665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.452099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.453196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.453697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.454005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.463172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.464902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:18.480685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:18.481790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:18.484921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:18.486897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:18.488485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.619137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a612-86e7-4889-8a06-24c2695ba373 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.662096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.665032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.665032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.665032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.665032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:18.665032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.665557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.686809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:18.693049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.809598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a8c75-93e0-4c5d-9028-95a45b8e0cc8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.845717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.846614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.846970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.847394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.890011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.940584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.942151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:19.058723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:19.060856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:19.081450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:19.172380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6b2c-8e27-4508-a366-7b824618d762 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:19.208773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:19.209373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:19.209630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:19.209892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:19.220291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:19.221890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:19.238594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:19.239656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:19.240551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:19.240551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:19.240551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:19.244525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:19.245345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:19.322296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:19.365216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc049-d3a4-459c-9f9c-e75e13a5e9ba None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:19.402270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:19.403085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:19.403562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:19.403910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:19.404617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:19.404919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:19.406322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:19.424540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:19.425695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:19.531983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:19.574972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3820-4da0-446d-898c-e755fef92166 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:19.626218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:19.627163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:19.627665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:19.628188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:19.639732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:19.641413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:19.653958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:19.655074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:19.656183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:19.661781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:19.662484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:19.775177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47567c29-bd36-4d50-b534-5dd647e105c3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:19.800904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:19.814063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:19.814670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:19.814952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:19.815223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:19.815910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:19.816211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:19.817630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed122a2f-6aa2-4565-8f18-00ba85c8b6c0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:19.831171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:19.837773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:19.972443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ac06a-0d5f-4b1e-8181-413b1d2b43d8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:20.005565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:20.014081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:20.014736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:20.015015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:20.015289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:20.016024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=454c3f093d8d465294f2b0fe786a1fa1) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:20.016385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:20.018028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaf992-88f1-4101-8207-b93045060cb1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:20.024313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:19 2022] GET /identity/v3/role_assignments?user.id=454c3f093d8d465294f2b0fe786a1fa1&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:22.072373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0069d3-ad06-45ab-b347-7312797fd6b1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.072910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0069d3-ad06-45ab-b347-7312797fd6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.073029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0069d3-ad06-45ab-b347-7312797fd6b1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.074386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:22.080208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.080686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.080783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.099785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:22.100968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:22.170657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:22.442751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0069d3-ad06-45ab-b347-7312797fd6b1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:22.560772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0069d3-ad06-45ab-b347-7312797fd6b1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:22.600200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:22.601003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.601327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.601689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.615567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:22.622607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:22.623861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:22.624870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:22.630673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:22.731298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887d1e-20b5-46dc-93c8-3f18d85bed50 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:22.757145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.769172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:22.769777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.770087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.770362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.771061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:22.771323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:22.772694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:22.780877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:22.786873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:22.833499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.897629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0820871-47c1-4d4a-aacd-ffeebe1391d3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:22.934226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:22.934944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.935223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.935499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.946779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:22.948437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:22.965316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:22.967460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:22.968375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:22.968375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:22.968375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:22.968375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:22.972797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.093695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61a1d-a960-4977-92d1-527b67360ea4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.128769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.129475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.129752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.130045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.130754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:23.131155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.132804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.147404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:23.153107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.256038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.263915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8874c-79ec-4688-b361-b031130e74aa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.306324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.306961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.307237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.307503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.315760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.317210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:23.329740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:23.330886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:23.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:23.337343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.397225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.467651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68697966-d843-47c8-822b-4c198ff815ed None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.503828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.504475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.504797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.505110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.505945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:23.506256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.507745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.526472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:23.532804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.641168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778498fa-264c-461c-b121-b2af9dad1589 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.676248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.676797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.677077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.677348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.690392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.691941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:23.707526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:23.708642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:23.710076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:23.710076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:23.710076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:23.710076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:23.714666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.815819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656befe-acc2-4826-bdac-7c5e1e557e93 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.818196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.850531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.851105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.851386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.851689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.852304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:23.852622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.853996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.867180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:23.872654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.882051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.980419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b48057-832b-4c24-ac04-d915292df573 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:24.014964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:24.015593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:24.015871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:24.016160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:24.022806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:24.024264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:24.036706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:24.037838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:24.039852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:24.043905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:24.143838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c259f-5855-43d6-899e-24b7466a8c20 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:24.177482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:24.178445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:24.178719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:24.179028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:24.179841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:24.180142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:24.181695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288fb44-3456-4da2-b7ec-adc145fe3ce4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:24.194420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:24.201021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:24.272828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:24.308456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eea8f-46a1-4d8c-b6b4-eabf4c500f1e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:24.346011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8978e1-da8d-4736-b2bb-7baf5df6195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:24.346688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8978e1-da8d-4736-b2bb-7baf5df6195c None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:24.346967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8978e1-da8d-4736-b2bb-7baf5df6195c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:24.347242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8978e1-da8d-4736-b2bb-7baf5df6195c None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/454c3f093d8d465294f2b0fe786a1fa1/roles/ef7588b93aa44be6a5f584e6695cab18` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:24.362826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8978e1-da8d-4736-b2bb-7baf5df6195c None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=454c3f093d8d465294f2b0fe786a1fa1, role_id=ef7588b93aa44be6a5f584e6695cab18)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:24.364654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8978e1-da8d-4736-b2bb-7baf5df6195c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:24.378322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:24 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/454c3f093d8d465294f2b0fe786a1fa1/roles/ef7588b93aa44be6a5f584e6695cab18 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:09:26.357905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a797-e565-4abf-822e-0d61fcc91d92 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.358460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a797-e565-4abf-822e-0d61fcc91d92 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.358460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a797-e565-4abf-822e-0d61fcc91d92 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.359785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:26.365133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.365539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.365677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.384339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:26.385563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:26.471992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:26.742805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418a797-e565-4abf-822e-0d61fcc91d92 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:26.770856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:26.852531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418a797-e565-4abf-822e-0d61fcc91d92 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:26.890923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:26.891549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.891828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.892105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.903314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:26.908721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:26.909690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:26.910833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 31 00:09:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:26.917066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:26.969627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:27.031880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540950d8-3e37-4b16-9521-910a8df77696 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:27.071883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:27.072488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.072769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.073042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.073708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:27.074041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:27.075465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:27.083534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 31 00:09:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:27.090173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:27.184007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:27.204917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2263-ebbb-4f0a-a288-72b74c82d2b1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:27.242212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:27.242813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.243103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.243376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.254742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:27.256194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:27.271281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:27.272325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:27.273589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:27.273589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:27.273589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:27.273589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:27.278955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:27.397024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01b3b2-a109-408d-b5d5-07044b8e5de7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:27.411003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:27.453391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:27.454067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.454337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.454650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.455302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:27.455599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:27.457000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:27.471610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:27.479992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:27.597799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364a94-e177-4d3a-885b-0f159d184c9b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:27.635749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:27.636384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.636672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.636932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.639783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:27.645173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:27.646693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:27.659265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:27.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:27.661293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:27.666332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:27.771576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56822b3-4329-41a1-81d0-05121290c069 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:27.808186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:27.808798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:27.809097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:27.809349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:27.810118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:27.810430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:27.811859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:27.830403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 00:09:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:27.836901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:27.969139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd78ed-243a-47eb-bac7-5b67c4c60516 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:28.007359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:28.008444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.009052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.009344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.085603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:28.094680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:28.096155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:28.214168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:28.215489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:28.244591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:28.324852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf6c3-c4f5-487c-8fcd-164e90fbeb5c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:28.362011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:28.362618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.362936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.363322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.374675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:28.376271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:28.391777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:28.393006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:28.394152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:28.394152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:28.394152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:28.394152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:28.398972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:28.510625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:28.517496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd102797-5566-4242-ba5b-8b9dcd3ee0c4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:28.555162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:28.555884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.556167 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.556473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.557168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:28.557475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:28.558922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:28.571563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:28.578253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:28.662515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:28.686998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8cdf0-7e10-4dfd-9138-61680e084e9f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:28.729730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:28.730409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.730752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.731548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.740127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:28.741599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:28.754627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:28.755861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:28.756995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:28.762167 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:28.878714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e03c6-4802-47b0-8593-e0ee78c4c4ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:28.915679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:28.916332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.916660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.916973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.917787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:28.918216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:28.920346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ff49-2590-4385-95f7-ffdf5783a4d0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:28.933367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:28.939990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:29.053834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5d44-8bfa-4814-a1dd-ab0d7661360b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:29.091531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:29.092154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:29.092482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:29.092859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:29.093598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] RBAC: Adding query filter params (role.id=ef7588b93aa44be6a5f584e6695cab18, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=454c3f093d8d465294f2b0fe786a1fa1) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:29.093952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:29.095487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0cc9-63e6-4a53-ba89-0fa9bf4a15b4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:29.101418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:28 2022] GET /identity/v3/role_assignments?user.id=454c3f093d8d465294f2b0fe786a1fa1&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=ef7588b93aa44be6a5f584e6695cab18 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:31.340811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1860434-520a-42d6-9675-49b8527bc7d7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:31.341402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1860434-520a-42d6-9675-49b8527bc7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:31.341402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1860434-520a-42d6-9675-49b8527bc7d7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:31.342715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:31.348827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:31.349235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:31.349360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:31.357066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:31.373481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:31.374672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:31.452973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:31.757163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1860434-520a-42d6-9675-49b8527bc7d7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:31.776376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:31.880595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1860434-520a-42d6-9675-49b8527bc7d7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:31.923465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:31.924101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:31.924453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:31.924651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:31.938013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:31.943612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:31.944676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:31.945556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:31.951289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.061877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ad6b-293d-4a1c-8580-2fef8fed8446 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.092208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.097632 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.098249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.098529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.098788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.099443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:32.099735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.101096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.109833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:32.115777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.198750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.225455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717d23-7afc-4078-8468-46deba76484f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.267381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.268082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.268391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.268729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.280214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.281675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:32.299819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:32.306887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:32.307813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:32.307813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:32.307813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:32.307813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:32.308055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.415047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7055ad-1fd4-4d56-91f4-ed9fe817c7cf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.465103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.465770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.466090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.466369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.467020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:32.467345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.468728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.482484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:32.488426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.596179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f594-6abf-4106-a6aa-7ac9b467074e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.624255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.632852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.633478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.633760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.634061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.643689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.645564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:32.658612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:32.659946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:32.661176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:32.665973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.729137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.781507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f523e21-9227-4118-a8b7-1adf55037da2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.820137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.820741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.821015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.821282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.822044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:32.822342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.823767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.841661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:32.847844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.957500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1fde8-409f-4b9f-a584-afa5dfc36dbc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.993395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.994037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.994320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.994589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.058015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:33.073102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:33.074664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:33.180155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:33.186379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:33.289047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53995f-c216-4e5a-9fad-3be6fc2c4692 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:33.303733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:33.326875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:33.327567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:33.327918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:33.328194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.339007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:33.340841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:33.355542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:33.357200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:33.358252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:33.358252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:33.358252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:33.362004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:33.363351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:33.473612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:33.487986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68ef4d-3eef-48bf-8ed1-d52b4ca2f4a3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:33.523537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:33.524156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:33.524418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:33.524690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.525335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:33.525678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:33.527201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:33.540347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:33.547129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:33.669162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f97abc-bfe0-40c3-81d3-65ff1169e8d8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:33.705143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:33.705764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:33.706065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:33.706331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.712823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:33.714294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:33.727896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:33.729012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:33.730113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:33.730717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:33.737709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:33.855307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1e30-4a28-4dca-a8ca-5b97d0a1a331 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:33.895951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:33.896586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:33.896864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:33.897137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:33.897922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:33.898236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:33.899754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271dc2-3277-4177-9034-0af63d1080ee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:33.918938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:33.920256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:33.952966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:34.030996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbe751-da31-4387-b205-b9555f4987a9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:34.066434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:34.067044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:34.067318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:34.067584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:34.068309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=454c3f093d8d465294f2b0fe786a1fa1) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:34.068611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:34.070086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9def203-f09d-46e1-b5b6-f37a56a591fc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:34.085883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:33 2022] GET /identity/v3/role_assignments?user.id=454c3f093d8d465294f2b0fe786a1fa1&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=7c753c584d524b31b4742805d7365f68 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:35.955364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e8035-d66a-448a-ac71-dc6ae8954810 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.955853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e8035-d66a-448a-ac71-dc6ae8954810 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.955966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e8035-d66a-448a-ac71-dc6ae8954810 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.957233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:35.962466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.962862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.962998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.980592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:35.981749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:36.048337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:36.311036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e8035-d66a-448a-ac71-dc6ae8954810 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:36.321760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:36.412380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e8035-d66a-448a-ac71-dc6ae8954810 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:36.451087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:36.451788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:36.452065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:36.452397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:36.464433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:36.473245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:36.474385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:36.475390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:36.480905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:36.499067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:36.583594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed804ab-5e51-45f8-a240-25520f316cbd None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:36.615671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:36.616268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:36.616548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:36.616821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:36.617474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:36.617776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:36.619180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:36.627407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:36.633137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:36.698434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:36.732232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5da2c-36ca-431c-bd77-709475720f17 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:36.763504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:36.764112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:36.764385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:36.764654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:36.774648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:36.776079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:36.790227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:36.791313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:36.792381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:36.792381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:36.792381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:36.792381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:36.797196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:36.881411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:36.900223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5e6e-dcce-425f-a5ae-2e47c22f5e67 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:36.938665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:36.939260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:36.939530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:36.939798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:36.940426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:36.940724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:36.942112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:36.953370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:36.959098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.055370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79f0e-cdb2-49af-a6a8-a9c874e777f0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.073919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.089809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.090974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.091247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.091513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.099684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.101106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:37.112910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:37.114067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:37.115055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:37.119817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.215599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38515cb-2c74-40d6-88fb-0ea8ac24f738 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.248818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.249404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.249682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.249983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.250706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:37.251009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.252425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.260799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.269144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:37.274891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.370900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aaeb8-d9a1-4e16-8cf0-2b42bbdd0b6d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.403839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.404644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.404787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.405120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.416860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.419226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:37.436788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:37.438086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:37.439515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:37.439515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:37.439515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:37.439515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:37.444209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.541898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71712-d16c-4d62-8a69-69521fa004c6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.574787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.575382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.575659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.575929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.576563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:37.576863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.578250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.588957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:37.595186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.626418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.692987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ca0e4-ca06-4a0d-9980-15c723a3e5d5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.725185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.725804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.726110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.726384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.733315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.734776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:37.746868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:37.747892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:37.748899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:37.753742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.810662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.851385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635595-d7cd-49ee-95d7-75f697efc5af None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.884150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.884685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.884957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.885220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.885927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:37.886225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:37.887666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01a399-0241-45bc-8b8e-7c96bff17fd9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:37.899042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:37.904960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.992221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:38.001503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dea0a3-4f66-422d-8750-b70a52d2a9ac None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:38.033184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9dcf0-66aa-4b0f-834b-f17446a75a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:38.033810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9dcf0-66aa-4b0f-834b-f17446a75a3b None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.034117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9dcf0-66aa-4b0f-834b-f17446a75a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.034388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9dcf0-66aa-4b0f-834b-f17446a75a3b None admin] PATH_INFO: `/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/454c3f093d8d465294f2b0fe786a1fa1/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.036225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9dcf0-66aa-4b0f-834b-f17446a75a3b None admin] RBAC: Authorizing `identity:create_grant(project_id=b78c4cbce72543de99f295f9c19f6b68, user_id=454c3f093d8d465294f2b0fe786a1fa1, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:38.037663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9dcf0-66aa-4b0f-834b-f17446a75a3b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:38.050466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:37 2022] PUT /identity/v3/projects/b78c4cbce72543de99f295f9c19f6b68/users/454c3f093d8d465294f2b0fe786a1fa1/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:39.946101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7ec5-fc5b-49f1-9d05-c2453a63a797 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:39.946611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7ec5-fc5b-49f1-9d05-c2453a63a797 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:39.946703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc7ec5-fc5b-49f1-9d05-c2453a63a797 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:39.947986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:09:39.952939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:39.953351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:39.953478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:39.971239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:39.972427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:40.036634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:40.305873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc7ec5-fc5b-49f1-9d05-c2453a63a797 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:40.405798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc7ec5-fc5b-49f1-9d05-c2453a63a797 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:40.431736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:40.451584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:40.452303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:40.452655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:40.453008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:40.466239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:40.472687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:40.473713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:40.474653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:40.481652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:40.559937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:40.578347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3b33f-da17-499c-82ab-cd097d68edcb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:40.611182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:40.611768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:40.612045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:40.612314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:40.612969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:40.613269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:40.614649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:40.622353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:40.627978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:40.727054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b88f8a-1943-4f2b-88b4-6be477660771 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:40.759454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:40.760062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:40.760338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:40.760606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:40.771422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:40.772873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:40.791911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:40.793129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:40.794271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:40.794271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:40.794271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:40.794271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:40.799352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:40.897031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ea7ec-4a53-4ffd-9d8a-8d6d494d1985 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:40.929260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:40.929875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:40.930161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:40.930430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:40.931065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:40.931368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:40.932717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:40.944441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:40.950079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:40.979547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.047395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc30887-1e57-4b3d-8ed9-5a6ed57b8805 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.079164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.079790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.080052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.080322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.087504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.088938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:41.100239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:41.101348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:41.102369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:41.107628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.111392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.203758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688710-85c1-485e-b419-9070759966c6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.236895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.237481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.237759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.238060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.238775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:41.239080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.240492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.257731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:41.263178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.351828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.361984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db683f-6885-4fb8-b49a-1cdc783e39c1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.394317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.394903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.395180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.395451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.459497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.460870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.548638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.559467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:41.565256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.623695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.661432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3ba2-bc5c-4e77-a6d8-4c1ccf7829f7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.694560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.695562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.695967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.696242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.707988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.709463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:41.724030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:41.725216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:41.726373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:41.726373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:41.726373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:41.726373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:41.730904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.834586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a718cc-b07c-46a8-89a6-400b20ba6a0a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.869216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.869823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.870128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.870404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.871073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:41.871376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.872741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.884139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:41.889898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.988933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7311f-d668-4ba2-b53f-58ac0c033126 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:42.003242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:42.023952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:42.024566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:42.024847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:42.025118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:42.034155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:42.035596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:42.046752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:42.047820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 31 00:09:42.048730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:42.053988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:42.103311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:42.155596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ac3c-f91b-49b0-a9c5-b0f51ec95243 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:42.189108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:42.189705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:42.190013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:42.190287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:42.190976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:42.191278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:42.192705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50131d02-d61f-4fb9-a214-7b1a9bb364dc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:42.204314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:42.210730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:42.311443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2628e4-7392-4fdd-a815-17155f1d6f7d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:42.343187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:42.343777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:42.344054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:42.344322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:42.345037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] RBAC: Adding query filter params (role.id=7c753c584d524b31b4742805d7365f68, scope.project.id=b78c4cbce72543de99f295f9c19f6b68, user.id=454c3f093d8d465294f2b0fe786a1fa1) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:42.345339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:42.346842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932789b0-4c69-49f6-a04f-45f52bd0eac9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:42.352353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:42 2022] GET /identity/v3/role_assignments?user.id=454c3f093d8d465294f2b0fe786a1fa1&scope.project.id=b78c4cbce72543de99f295f9c19f6b68&role.id=7c753c584d524b31b4742805d7365f68 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:44.262782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83566-182f-4721-87cb-253d35a17d5b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.263291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83566-182f-4721-87cb-253d35a17d5b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.263384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83566-182f-4721-87cb-253d35a17d5b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.264652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:44.269611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.270031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.270200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.288475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:44.289652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:44.319145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.356023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:44.639150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83566-182f-4721-87cb-253d35a17d5b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.736908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83566-182f-4721-87cb-253d35a17d5b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.747159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.769762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.770408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.770689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.770962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.771531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:44.772901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:44.782089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:44.783355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:44.784422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:44.789069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.885071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23be48b-c713-4643-9fde-29780ac2499a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.918091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.918623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.918897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.919165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.919781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:44.920077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:44.921421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c7859-1429-4a8f-bf7d-aae8dd92ad51 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:44.926041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:44.932079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:45.028659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04607ddc-c3e9-4a6c-bc1f-38f0c99fb76d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:45.061097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:45.061679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:45.061991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:45.062264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:45.062883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] RBAC: Adding query filter params (type=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:45.063185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:45.064543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbec28-ea10-4c50-9756-f85e395775ef None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:45.068801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:46.948631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df2ed9-65fa-4eec-8fd9-cd6c3487dcc4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:46.949731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df2ed9-65fa-4eec-8fd9-cd6c3487dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:46.949731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df2ed9-65fa-4eec-8fd9-cd6c3487dcc4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:46.951050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:46.956072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f300e-0ea3-48bd-901e-622a22aed78c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:46.956459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f300e-0ea3-48bd-901e-622a22aed78c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:46.956612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f300e-0ea3-48bd-901e-622a22aed78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:46.974803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6d2f300e-0ea3-48bd-901e-622a22aed78c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:46.975959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6d2f300e-0ea3-48bd-901e-622a22aed78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:47.004353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:47.039907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:47.301096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df2ed9-65fa-4eec-8fd9-cd6c3487dcc4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:47.332147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:47.401033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df2ed9-65fa-4eec-8fd9-cd6c3487dcc4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:47.447630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f2367-67bc-4693-88b6-094b62665811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:47.448382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f2367-67bc-4693-88b6-094b62665811 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.448936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f2367-67bc-4693-88b6-094b62665811 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.449321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f2367-67bc-4693-88b6-094b62665811 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:47.450132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f2367-67bc-4693-88b6-094b62665811 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:47.451811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f2367-67bc-4693-88b6-094b62665811 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:47.469650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 31 00:09:47 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:49.354355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79834aa-feca-4f95-8890-6df38ae22d23 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:49.354898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79834aa-feca-4f95-8890-6df38ae22d23 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:49.355051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79834aa-feca-4f95-8890-6df38ae22d23 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:49.356319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:49.361462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:49.361907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:49.362012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:49.380007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:49.381197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:49.454410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:49.719656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79834aa-feca-4f95-8890-6df38ae22d23 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:49.818832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79834aa-feca-4f95-8890-6df38ae22d23 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:49.850718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:49.851335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:49.851616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:49.851890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:49.852459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:49.853823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:49.863082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:49.864180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:49.865107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:09:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:49.870102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:49.889470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:49.982425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fac41-76ea-4965-8d02-beef0853a91b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:50.016263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:50.016870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.017150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.017421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.018078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:50.018383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:50.019753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:50.024732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 00:09:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:50.031299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:50.064635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:50.132608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b89f20-8a3c-4f70-aabb-2d9775291c7f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:50.164901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:50.165493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.165773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.166099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.166791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] RBAC: Adding query filter params (interface=public, service_id=63441a04fad54c9daaa9e7efcfdb0605, region_id=RegionOne) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:50.167094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:50.169071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fd1ab-e340-47a4-b0d9-30668003174c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:50.174074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 31 00:09:50 2022] GET /identity/v3/endpoints?service_id=63441a04fad54c9daaa9e7efcfdb0605&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:50.179833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:50.256683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:50.274141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ad89b-a7a6-4a0e-9aa7-d964a2d8b3d3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:50.307252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35345f7-6d27-41f1-a298-78f5187b91a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:50.307842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35345f7-6d27-41f1-a298-78f5187b91a6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.308119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35345f7-6d27-41f1-a298-78f5187b91a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.308391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35345f7-6d27-41f1-a298-78f5187b91a6 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.308984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35345f7-6d27-41f1-a298-78f5187b91a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:50.310377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35345f7-6d27-41f1-a298-78f5187b91a6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:50.316907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 31 00:09:50 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:09:52.181402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892e6f2-7a83-44e5-9223-8e31e2d4edb2 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.181921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892e6f2-7a83-44e5-9223-8e31e2d4edb2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.181921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892e6f2-7a83-44e5-9223-8e31e2d4edb2 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.183838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:52.189093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.189469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.189637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.207200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:52.208362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:52.271522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:52.551382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892e6f2-7a83-44e5-9223-8e31e2d4edb2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:52.648514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:52.656115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892e6f2-7a83-44e5-9223-8e31e2d4edb2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:52.690730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:52.691345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.691622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.691893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.692468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:52.694266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:52.706882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:52.708091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 31 00:09:52.708942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 31 00:09:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:52.713986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:52.786943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:52.810226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecc34c-63d5-4b4b-99d8-cbc14e9db0f5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:52.842289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:52.842873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.843148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.843420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.844034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:52.844331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:52.845676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160959ee-3721-45c6-b86c-862235e57b94 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:52.850564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 31 00:09:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:52.856711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:52.952019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac157d5-5812-43c4-85e7-2b9b154d812c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:52.984779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f107e-90fb-4d80-97b1-de3e5a2d24f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:52.985372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f107e-90fb-4d80-97b1-de3e5a2d24f3 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.985649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f107e-90fb-4d80-97b1-de3e5a2d24f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.985948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f107e-90fb-4d80-97b1-de3e5a2d24f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.986602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f107e-90fb-4d80-97b1-de3e5a2d24f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:52.987957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f107e-90fb-4d80-97b1-de3e5a2d24f3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:53.015282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:09:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:10:02.847669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=30 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:03.009625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:56.788388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e4ef9-de15-4a67-8661-088427ae8ce6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:56.789020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e4ef9-de15-4a67-8661-088427ae8ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:56.789281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e4ef9-de15-4a67-8661-088427ae8ce6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:56.792074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:10:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:56.797707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1a40f-83d1-4337-8529-e07240a96fd2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:56.798237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1a40f-83d1-4337-8529-e07240a96fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:56.798448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1a40f-83d1-4337-8529-e07240a96fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:56.889950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eca1a40f-83d1-4337-8529-e07240a96fd2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:56.891876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eca1a40f-83d1-4337-8529-e07240a96fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:57.081886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:57.371681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f8bf-93b1-4e18-b39f-4328d3106059 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:57.372012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f8bf-93b1-4e18-b39f-4328d3106059 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:57.372235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f8bf-93b1-4e18-b39f-4328d3106059 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:57.373824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 654/1309] 10.222.0.49 () {54 vars in 965 bytes} [Wed Aug 31 00:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:57.379921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c8ab1-4d86-4748-8eb4-4fdd6bdf7b5f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:57.380584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c8ab1-4d86-4748-8eb4-4fdd6bdf7b5f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:57.381296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c8ab1-4d86-4748-8eb4-4fdd6bdf7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:57.472716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-238c8ab1-4d86-4748-8eb4-4fdd6bdf7b5f None None] MFA Rules not processed for user `f83352aa0c3843e09f2a666b753a7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:57.474395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-238c8ab1-4d86-4748-8eb4-4fdd6bdf7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:57.498081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:57.561336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 656/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Wed Aug 31 00:10:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:10:57.570867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897f8bf-93b1-4e18-b39f-4328d3106059 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:57.572639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0897f8bf-93b1-4e18-b39f-4328d3106059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:57.693684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897f8bf-93b1-4e18-b39f-4328d3106059 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:57.780116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:57.780718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:57.780994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:57.781256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:57.782864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:57.838919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:57.902011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:57.903834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a69da-1f2d-48a9-8a14-c5fcd3c87f24 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:57.924258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 655/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:00.141758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c708-24f8-472c-ba94-b130607d2b44 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:00.142313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c708-24f8-472c-ba94-b130607d2b44 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:00.142423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c708-24f8-472c-ba94-b130607d2b44 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:00.143692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:00.148762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a10488-4898-4d7c-93d7-52bf5d62f098 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:00.149148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a10488-4898-4d7c-93d7-52bf5d62f098 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:00.149319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a10488-4898-4d7c-93d7-52bf5d62f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:00.231821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-66a10488-4898-4d7c-93d7-52bf5d62f098 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:00.233024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-66a10488-4898-4d7c-93d7-52bf5d62f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:00.330662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:00.613696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c708-24f8-472c-ba94-b130607d2b44 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:00.615268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aff3c708-24f8-472c-ba94-b130607d2b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:00.717486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c708-24f8-472c-ba94-b130607d2b44 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:00.788232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:00.791687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:00.792694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:00.793294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:00.793913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:00.795518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:00.906994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:00.912893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17711c4d-80aa-4158-a38b-c82fab9bf58e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:00.932626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 658/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:03.170795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06edce9-18ff-41f3-b452-d8a38dd8bc70 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:03.171310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06edce9-18ff-41f3-b452-d8a38dd8bc70 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:03.171310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06edce9-18ff-41f3-b452-d8a38dd8bc70 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:03.172595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 657/1315] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:03.178053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767d66c-914e-40c7-a294-7f738f045e66 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:03.178462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767d66c-914e-40c7-a294-7f738f045e66 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:03.178592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767d66c-914e-40c7-a294-7f738f045e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:03.243522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8767d66c-914e-40c7-a294-7f738f045e66 None None] MFA Rules not processed for user `c3a9cca237a24764b965735abc50c372`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:03.244697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8767d66c-914e-40c7-a294-7f738f045e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:03.293951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:03.337627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 659/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:03.618572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06edce9-18ff-41f3-b452-d8a38dd8bc70 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:03.620115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c06edce9-18ff-41f3-b452-d8a38dd8bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:03.629699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:03.721474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06edce9-18ff-41f3-b452-d8a38dd8bc70 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:03.794509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:03.795100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:03.795376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:03.795644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:03.797230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:03.857876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:03.903865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:03.905330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089906a-9197-4e91-93bc-9b3ccd4fdd03 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:03.923236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 658/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:06.369261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b5d6-9e5a-42aa-b82d-95f733a806bb None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.369790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b5d6-9e5a-42aa-b82d-95f733a806bb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.369790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b5d6-9e5a-42aa-b82d-95f733a806bb None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.371173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 660/1318] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:06.376152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c905339-0c6c-49af-88ad-8fddcfecb198 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.376553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c905339-0c6c-49af-88ad-8fddcfecb198 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.376717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c905339-0c6c-49af-88ad-8fddcfecb198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.441660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0c905339-0c6c-49af-88ad-8fddcfecb198 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:06.442845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c905339-0c6c-49af-88ad-8fddcfecb198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:06.539926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 659/1319] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:06.822171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7b5d6-9e5a-42aa-b82d-95f733a806bb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:06.823710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d9c7b5d6-9e5a-42aa-b82d-95f733a806bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:06.925291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7b5d6-9e5a-42aa-b82d-95f733a806bb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.997374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.997997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.998276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.998548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:07.000119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:07.007437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:07.108906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:07.110299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce41a23-c6d8-4245-8a12-0edfe808af50 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:07.128226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 661/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:09.674343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f11c8-4ec3-433a-97a2-2319118aa3f9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:09.674876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f11c8-4ec3-433a-97a2-2319118aa3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:09.674876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f11c8-4ec3-433a-97a2-2319118aa3f9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:09.676496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 660/1321] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:09.682223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0c3f-99d0-4319-b006-a9015f8930a8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:09.682639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0c3f-99d0-4319-b006-a9015f8930a8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:09.682774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0c3f-99d0-4319-b006-a9015f8930a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:09.750131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-842d0c3f-99d0-4319-b006-a9015f8930a8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:09.751331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-842d0c3f-99d0-4319-b006-a9015f8930a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:09.809174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:09.850032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 662/1322] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:10.145444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70143-0616-4d3e-a681-c79cc75d410f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:10.145838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70143-0616-4d3e-a681-c79cc75d410f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:10.146199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70143-0616-4d3e-a681-c79cc75d410f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:10.148181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 965 bytes} [Wed Aug 31 00:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:10.154290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c264-72a8-4612-928c-f3f7c2739a7c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:10.154636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c264-72a8-4612-928c-f3f7c2739a7c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:10.154975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c264-72a8-4612-928c-f3f7c2739a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:10.230932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f467c264-72a8-4612-928c-f3f7c2739a7c None None] MFA Rules not processed for user `f83352aa0c3843e09f2a666b753a7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:10.232126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f467c264-72a8-4612-928c-f3f7c2739a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:10.306734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 663/1324] 10.222.0.49 () {58 vars in 1062 bytes} [Wed Aug 31 00:11:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:11:10.315678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70143-0616-4d3e-a681-c79cc75d410f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:10.317106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f1d70143-0616-4d3e-a681-c79cc75d410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:10.336383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:10.420585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70143-0616-4d3e-a681-c79cc75d410f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:10.491579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:10.492173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:10.492447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:10.492713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:10.494317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:10.563314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:10.600250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:10.602205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548062e6-fa6b-4d31-b163-82d1d4eac4f5 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:10.619744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 662/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:12.790112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490020-a95b-4e4a-87e4-4579ede50f18 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:12.790709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490020-a95b-4e4a-87e4-4579ede50f18 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:12.790709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490020-a95b-4e4a-87e4-4579ede50f18 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:12.792017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 664/1326] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:12.797958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e314a-5b5a-4cf0-83f2-098437c90c11 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:12.798496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e314a-5b5a-4cf0-83f2-098437c90c11 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:12.799127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e314a-5b5a-4cf0-83f2-098437c90c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:12.870313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-219e314a-5b5a-4cf0-83f2-098437c90c11 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:12.871221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-219e314a-5b5a-4cf0-83f2-098437c90c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:12.971639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 663/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:13.254418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10490020-a95b-4e4a-87e4-4579ede50f18 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:13.255895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-10490020-a95b-4e4a-87e4-4579ede50f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:13.324901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:13.368561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10490020-a95b-4e4a-87e4-4579ede50f18 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:13.442244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:13.442852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:13.443133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:13.443409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:13.445049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:13.551797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:13.554290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:13.556044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2256-edcd-40be-885c-971afd6fe7cc service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:13.574492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 665/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:15.541675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98862b9d-0a22-4963-bdb7-d9147a888ecf None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.542220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98862b9d-0a22-4963-bdb7-d9147a888ecf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.542313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98862b9d-0a22-4963-bdb7-d9147a888ecf None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.543590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 664/1329] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:15.548751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c523678-20b7-427f-a59e-39bf0b58ec12 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.549170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c523678-20b7-427f-a59e-39bf0b58ec12 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.549280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c523678-20b7-427f-a59e-39bf0b58ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.636269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8c523678-20b7-427f-a59e-39bf0b58ec12 None None] MFA Rules not processed for user `c3a9cca237a24764b965735abc50c372`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:15.637488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8c523678-20b7-427f-a59e-39bf0b58ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:15.738504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 666/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:16.025643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98862b9d-0a22-4963-bdb7-d9147a888ecf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:16.027189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-98862b9d-0a22-4963-bdb7-d9147a888ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:16.058695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:16.131474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98862b9d-0a22-4963-bdb7-d9147a888ecf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:16.209236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:16.209910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:16.210223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:16.210623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:16.212338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:16.303612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:16.338272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:16.339746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9a6d-4f93-45d8-a6a5-a01c3fb23856 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:16.362505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 665/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:18.670440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604fe6-2321-470d-9ddd-137c31145671 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:18.671039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604fe6-2321-470d-9ddd-137c31145671 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:18.671039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604fe6-2321-470d-9ddd-137c31145671 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:18.672318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 667/1332] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:18.677551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe30dd-fbf7-4673-ad8e-98f8f5cf8e5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:18.678465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe30dd-fbf7-4673-ad8e-98f8f5cf8e5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:18.678648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe30dd-fbf7-4673-ad8e-98f8f5cf8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:18.743398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4cbe30dd-fbf7-4673-ad8e-98f8f5cf8e5b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:18.744593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4cbe30dd-fbf7-4673-ad8e-98f8f5cf8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:18.837012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 666/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:19.120670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604fe6-2321-470d-9ddd-137c31145671 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:19.122210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f604fe6-2321-470d-9ddd-137c31145671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:19.188937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:19.223126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604fe6-2321-470d-9ddd-137c31145671 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:19.293412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:19.294038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:19.294315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:19.294582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:19.296161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:19.400869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:19.402262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbaeb-8f54-4e3e-8226-c6a49e06206f service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:19.413495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:19.421503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:21.353973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27e533-ac46-47e8-9488-f73140283ca1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.354533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27e533-ac46-47e8-9488-f73140283ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.354533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27e533-ac46-47e8-9488-f73140283ca1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.355885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 667/1335] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:21.361026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be522941-6c6e-4046-b75b-924196cb46e9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.361453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be522941-6c6e-4046-b75b-924196cb46e9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.361569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be522941-6c6e-4046-b75b-924196cb46e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.427007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-be522941-6c6e-4046-b75b-924196cb46e9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:21.428205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-be522941-6c6e-4046-b75b-924196cb46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:21.531456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:21.814602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27e533-ac46-47e8-9488-f73140283ca1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:21.816138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ec27e533-ac46-47e8-9488-f73140283ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:21.856131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:21.920006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27e533-ac46-47e8-9488-f73140283ca1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:21.991002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:21.991599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.991877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.992150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.993737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:22.075740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:22.100855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:22.102307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dc14a-d6a9-45c7-b027-3e202547c8d2 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:22.119426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 668/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:24.323281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19a03-0aad-4fba-9afa-ca46b276e4ef None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.323843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19a03-0aad-4fba-9afa-ca46b276e4ef None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.323843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19a03-0aad-4fba-9afa-ca46b276e4ef None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.325190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 670/1338] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:24.330291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a826856-4216-46e5-9309-eeb796f2643c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.330734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a826856-4216-46e5-9309-eeb796f2643c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.330831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a826856-4216-46e5-9309-eeb796f2643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.395128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5a826856-4216-46e5-9309-eeb796f2643c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:24.396334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5a826856-4216-46e5-9309-eeb796f2643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:24.489307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:24.771088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19a03-0aad-4fba-9afa-ca46b276e4ef None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:24.773199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-71e19a03-0aad-4fba-9afa-ca46b276e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:24.847525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:24.876464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19a03-0aad-4fba-9afa-ca46b276e4ef None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:24.951951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:24.952549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.952823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.953089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.954692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:25.060269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.061639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1886b4-6d81-4798-ac02-3e85b0663d91 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.079712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 671/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:28.904806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a524-a2a8-46ef-afdd-e6b49db81434 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:28.905317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a524-a2a8-46ef-afdd-e6b49db81434 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:28.905413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a524-a2a8-46ef-afdd-e6b49db81434 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:28.906715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:28.912369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e019324-d868-4ca1-9317-a7db9cce72c3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:28.912768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e019324-d868-4ca1-9317-a7db9cce72c3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:28.912923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e019324-d868-4ca1-9317-a7db9cce72c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:28.918633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:28.979216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4e019324-d868-4ca1-9317-a7db9cce72c3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:28.980415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4e019324-d868-4ca1-9317-a7db9cce72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:29.084725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:29.373069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a524-a2a8-46ef-afdd-e6b49db81434 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.374598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ac99a524-a2a8-46ef-afdd-e6b49db81434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:29.423264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:29.481112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a524-a2a8-46ef-afdd-e6b49db81434 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.555456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.556056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.556333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.556606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:29.558202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:29.653360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:29.670949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:29.672385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388deb48-f651-417d-ac9b-93df28895f28 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:29.691173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:32.231166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a998a-4447-4635-aa44-ab189f9e02f4 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:32.231567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a998a-4447-4635-aa44-ab189f9e02f4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:32.231711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a998a-4447-4635-aa44-ab189f9e02f4 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:32.233080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:32.238400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0bde-049d-40d4-a67f-51723d02ce8b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:32.238865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0bde-049d-40d4-a67f-51723d02ce8b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:32.238965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0bde-049d-40d4-a67f-51723d02ce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:32.306464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1c5c0bde-049d-40d4-a67f-51723d02ce8b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:32.307662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1c5c0bde-049d-40d4-a67f-51723d02ce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:32.403572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:32.686128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a998a-4447-4635-aa44-ab189f9e02f4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:32.687716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-135a998a-4447-4635-aa44-ab189f9e02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:32.774660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:32.791992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a998a-4447-4635-aa44-ab189f9e02f4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:32.867059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:32.867661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:32.867939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:32.868209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:32.869873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:32.984664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:32.986141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85c742-4264-4ec2-9386-45b52df6389e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:33.004092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:36.885756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9af682-907b-4ab5-9693-a519e3ab74e4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:36.886284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9af682-907b-4ab5-9693-a519e3ab74e4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:36.886378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9af682-907b-4ab5-9693-a519e3ab74e4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:36.887740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:36.892872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5445eb-a688-4bc1-b833-fc68f2c8b3b2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:36.893250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5445eb-a688-4bc1-b833-fc68f2c8b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:36.893418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5445eb-a688-4bc1-b833-fc68f2c8b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:36.909310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:36.967932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bd5445eb-a688-4bc1-b833-fc68f2c8b3b2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:36.969251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bd5445eb-a688-4bc1-b833-fc68f2c8b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:37.071471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:37.350348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9af682-907b-4ab5-9693-a519e3ab74e4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:37.351913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8d9af682-907b-4ab5-9693-a519e3ab74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:37.412292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:37.459671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9af682-907b-4ab5-9693-a519e3ab74e4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:37.534967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:37.535578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:37.535882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:37.536163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:37.537912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:37.642666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:37.646063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:37.648143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802f011-a37d-48cf-9483-b80568e99edc service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:37.666329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:42.561262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd00c-fea3-4a7f-8f5b-78fd125d7a57 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:42.561746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd00c-fea3-4a7f-8f5b-78fd125d7a57 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:42.562226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd00c-fea3-4a7f-8f5b-78fd125d7a57 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:42.565533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:42.571691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3157-5b11-4b80-8a06-6d3829843afb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:42.571691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3157-5b11-4b80-8a06-6d3829843afb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:42.572205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e3157-5b11-4b80-8a06-6d3829843afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:42.665687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7e0e3157-5b11-4b80-8a06-6d3829843afb None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:42.668840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7e0e3157-5b11-4b80-8a06-6d3829843afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:42.811737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:11:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:47.069537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=59 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:47.076163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86836-95b1-47a0-957c-f58d16a4f581 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:47.076916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86836-95b1-47a0-957c-f58d16a4f581 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:47.077593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86836-95b1-47a0-957c-f58d16a4f581 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:47.079346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 677/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:47.084897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656dc0e-5052-4480-a40c-37a3bf37fe59 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:47.085338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656dc0e-5052-4480-a40c-37a3bf37fe59 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:47.085681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656dc0e-5052-4480-a40c-37a3bf37fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:47.140073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:47.165098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d656dc0e-5052-4480-a40c-37a3bf37fe59 None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:47.166325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d656dc0e-5052-4480-a40c-37a3bf37fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:47.279047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 676/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:11:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:48.653614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c4c7f-3108-46f4-bb9a-d1b1ef48d9b1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:48.654242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c4c7f-3108-46f4-bb9a-d1b1ef48d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:48.654242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c4c7f-3108-46f4-bb9a-d1b1ef48d9b1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:48.655677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 678/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:48.660598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50529b4a-3e36-44ad-aeed-16b715b1c384 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:48.661009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50529b4a-3e36-44ad-aeed-16b715b1c384 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:48.661263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50529b4a-3e36-44ad-aeed-16b715b1c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:48.738914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-50529b4a-3e36-44ad-aeed-16b715b1c384 None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:48.740137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-50529b4a-3e36-44ad-aeed-16b715b1c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:48.782625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:48.849325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 677/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:11:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:11:52.288710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be982ee-333d-4b16-878f-4787a93135c0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:52.289203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be982ee-333d-4b16-878f-4787a93135c0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:52.289301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be982ee-333d-4b16-878f-4787a93135c0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:52.290695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 679/1356] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:52.295943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86c28-8b41-48fe-bc84-b8136805a711 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:52.296328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86c28-8b41-48fe-bc84-b8136805a711 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:52.296512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a86c28-8b41-48fe-bc84-b8136805a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:52.361309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-18a86c28-8b41-48fe-bc84-b8136805a711 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:52.362534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-18a86c28-8b41-48fe-bc84-b8136805a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:52.480264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 678/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:52.788229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ab2d3-b472-4c96-b319-036004c0cdca None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:52.788733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ab2d3-b472-4c96-b319-036004c0cdca None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:52.789157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ab2d3-b472-4c96-b319-036004c0cdca None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:52.790959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 680/1358] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 00:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:52.801511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d356b-5c7e-4f9f-a1dc-a798a1d155a4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:52.801974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d356b-5c7e-4f9f-a1dc-a798a1d155a4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:52.804601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d356b-5c7e-4f9f-a1dc-a798a1d155a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:52.846495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:52.911343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-626d356b-5c7e-4f9f-a1dc-a798a1d155a4 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:52.912674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-626d356b-5c7e-4f9f-a1dc-a798a1d155a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:53.045000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 679/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 00:11:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:53.053537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ab2d3-b472-4c96-b319-036004c0cdca None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:53.055172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dd4ab2d3-b472-4c96-b319-036004c0cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:53.209263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ab2d3-b472-4c96-b319-036004c0cdca None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:53.293971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:53.338917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:53.339442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:53.339715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:53.339982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:53.341684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:53.436859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:53.438631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c741f-fae2-4c8b-9714-31198d0e53f4 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:53.458099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 681/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:55.596288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e582f-ea3f-4045-984d-1ebf87829c2e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:55.596851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e582f-ea3f-4045-984d-1ebf87829c2e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:55.596851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e582f-ea3f-4045-984d-1ebf87829c2e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:55.601299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:55.604230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2afe48-7cc3-4ff7-8bc4-1e99e2dc0f0e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:55.604608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2afe48-7cc3-4ff7-8bc4-1e99e2dc0f0e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:55.604608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2afe48-7cc3-4ff7-8bc4-1e99e2dc0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:55.678787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cb2afe48-7cc3-4ff7-8bc4-1e99e2dc0f0e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:55.680012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cb2afe48-7cc3-4ff7-8bc4-1e99e2dc0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:55.720739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:55.794149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:56.087138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e582f-ea3f-4045-984d-1ebf87829c2e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:56.089066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc8e582f-ea3f-4045-984d-1ebf87829c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:56.191506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:56.282480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e582f-ea3f-4045-984d-1ebf87829c2e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:56.400109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:56.400719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:56.400999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:56.401272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:56.402899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:56.428032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:56.504995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:56.506813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89634-fc0e-4822-b31a-80bbb03e5d72 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:56.524862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:11:58.752525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8818f-2198-47e7-a18d-a66114984032 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:58.753080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8818f-2198-47e7-a18d-a66114984032 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:58.753190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8818f-2198-47e7-a18d-a66114984032 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:58.755481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:58.761016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eaeff-7a65-4e7c-abfa-69e176dd81ea None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:58.761503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eaeff-7a65-4e7c-abfa-69e176dd81ea None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:58.761648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eaeff-7a65-4e7c-abfa-69e176dd81ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:58.835689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bc3eaeff-7a65-4e7c-abfa-69e176dd81ea None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:58.836818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc3eaeff-7a65-4e7c-abfa-69e176dd81ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:58.939761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:58.945913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:59.249165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa24ab-062b-4efb-81e7-efe4b63b23ce None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:59.249581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa24ab-062b-4efb-81e7-efe4b63b23ce None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:59.250008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa24ab-062b-4efb-81e7-efe4b63b23ce None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:59.251721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 684/1366] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 00:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:59.257724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951712-2061-4d94-a8ba-57a4a79c97d2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:59.258054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951712-2061-4d94-a8ba-57a4a79c97d2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:59.258332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b951712-2061-4d94-a8ba-57a4a79c97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:59.340500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3b951712-2061-4d94-a8ba-57a4a79c97d2 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:59.341717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3b951712-2061-4d94-a8ba-57a4a79c97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:59.465729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 683/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 00:11:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:11:59.473453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa24ab-062b-4efb-81e7-efe4b63b23ce None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:59.475105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f7fa24ab-062b-4efb-81e7-efe4b63b23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:59.627773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa24ab-062b-4efb-81e7-efe4b63b23ce None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:59.649501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:59.756517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:59.757159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:59.757397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:59.757658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:59.759374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:59.852214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:59.853807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2909-c2fa-4d1d-8af8-f4736ea1ba97 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:59.873432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 685/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:00.527849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c571f-6355-4c51-8f75-6dfdd177cd34 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:00.528417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c571f-6355-4c51-8f75-6dfdd177cd34 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:00.528417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c571f-6355-4c51-8f75-6dfdd177cd34 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:00.529891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:00.534994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ba8f-7aa4-4f7f-ba70-f5e7cd745fc9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:00.535277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ba8f-7aa4-4f7f-ba70-f5e7cd745fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:00.535548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ba8f-7aa4-4f7f-ba70-f5e7cd745fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:00.570926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:00.607158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-51c1ba8f-7aa4-4f7f-ba70-f5e7cd745fc9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:00.608387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-51c1ba8f-7aa4-4f7f-ba70-f5e7cd745fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:00.713410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:01.260247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5921-86c5-4da0-9859-cc13cb0385c8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.260728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5921-86c5-4da0-9859-cc13cb0385c8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.261181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5921-86c5-4da0-9859-cc13cb0385c8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.262704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 685/1371] 10.222.0.49 () {54 vars in 964 bytes} [Wed Aug 31 00:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:01.267710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2677c-d485-401e-a2e6-93567422627f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.268139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2677c-d485-401e-a2e6-93567422627f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.268322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2677c-d485-401e-a2e6-93567422627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.345474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-69a2677c-d485-401e-a2e6-93567422627f None None] MFA Rules not processed for user `f2440b4168f446639c4dd3761ea57438`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:01.346699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-69a2677c-d485-401e-a2e6-93567422627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.397315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.431038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 687/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Aug 31 00:12:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:01.438605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5921-86c5-4da0-9859-cc13cb0385c8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:01.440201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5fd5921-86c5-4da0-9859-cc13cb0385c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.493046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.550688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5921-86c5-4da0-9859-cc13cb0385c8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:01.632214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:01.632821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.633098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.633370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.635049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:01.759075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:01.776267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:01.777678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc07aa0-bb24-44be-a9cf-20d8094bc4ec service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:01.799352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 686/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:01.865044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf526-9b00-4815-81f0-63e43bea173d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.865044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf526-9b00-4815-81f0-63e43bea173d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.865790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf526-9b00-4815-81f0-63e43bea173d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.870900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 688/1374] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:01.872281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9faf6-3e18-48f2-bda1-89de0c6fa3a1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:01.872281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9faf6-3e18-48f2-bda1-89de0c6fa3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:01.872281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9faf6-3e18-48f2-bda1-89de0c6fa3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:01.939054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5ba9faf6-3e18-48f2-bda1-89de0c6fa3a1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:01.940255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5ba9faf6-3e18-48f2-bda1-89de0c6fa3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.042458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 687/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:02.339819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf526-9b00-4815-81f0-63e43bea173d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:02.341410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bdfbf526-9b00-4815-81f0-63e43bea173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.489679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf526-9b00-4815-81f0-63e43bea173d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:02.549350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:02.612350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:02.612977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:02.613252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:02.613520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:02.615127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:02.704845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:02.706546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c814d-7ac0-4177-bda6-577f536e06fd service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:02.725161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 689/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:04.671214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf98267-6d64-46bb-83cb-ecf46ce2bd9f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:04.671698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf98267-6d64-46bb-83cb-ecf46ce2bd9f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:04.671797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf98267-6d64-46bb-83cb-ecf46ce2bd9f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:04.673104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 688/1377] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:04.679128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0467da-5cfa-4b41-b127-dfc6e8e2e880 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:04.679529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0467da-5cfa-4b41-b127-dfc6e8e2e880 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:04.679676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0467da-5cfa-4b41-b127-dfc6e8e2e880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:04.747451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6e0467da-5cfa-4b41-b127-dfc6e8e2e880 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:04.748661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6e0467da-5cfa-4b41-b127-dfc6e8e2e880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:04.756188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:04.867215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 690/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:05.155733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf98267-6d64-46bb-83cb-ecf46ce2bd9f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:05.157241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fcf98267-6d64-46bb-83cb-ecf46ce2bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:05.218215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:05.338641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf98267-6d64-46bb-83cb-ecf46ce2bd9f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:05.481950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:05.482554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:05.482824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:05.483084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:05.484813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:05.504479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:05.584754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:05.586361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8bc2-d1da-4413-9d78-436ac9bdc885 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:05.605780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 689/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:07.564190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae5175-22c7-463e-9440-a46e6ba64311 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:07.564747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae5175-22c7-463e-9440-a46e6ba64311 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:07.564747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae5175-22c7-463e-9440-a46e6ba64311 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:07.566838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 691/1380] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:07.571880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e81fc-f2c0-48a2-ae4f-491897d7530a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:07.572283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e81fc-f2c0-48a2-ae4f-491897d7530a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:07.572461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e81fc-f2c0-48a2-ae4f-491897d7530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:07.644115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-468e81fc-f2c0-48a2-ae4f-491897d7530a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:07.645336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-468e81fc-f2c0-48a2-ae4f-491897d7530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:07.745547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:07.752598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 690/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:08.045470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae5175-22c7-463e-9440-a46e6ba64311 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:08.047121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a3ae5175-22c7-463e-9440-a46e6ba64311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:08.205809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:08.217541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae5175-22c7-463e-9440-a46e6ba64311 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:08.339322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:08.340202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:08.340485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:08.340760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:08.342426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:08.436767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:08.438399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf15a84-8b5e-4c63-86f8-299e8533822f service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:08.449804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:08.459043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 692/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:10.437727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a748e-1db0-45af-95a9-05ff6d10cee6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:10.438308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a748e-1db0-45af-95a9-05ff6d10cee6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:10.438540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a748e-1db0-45af-95a9-05ff6d10cee6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:10.440186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 691/1383] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:10.445610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa765a-8f7a-4e0f-b3a8-aad2eeb6dfa0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:10.446045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa765a-8f7a-4e0f-b3a8-aad2eeb6dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:10.446189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa765a-8f7a-4e0f-b3a8-aad2eeb6dfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:10.518690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-08aa765a-8f7a-4e0f-b3a8-aad2eeb6dfa0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:10.520269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-08aa765a-8f7a-4e0f-b3a8-aad2eeb6dfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:10.637621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 693/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:10.925693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a748e-1db0-45af-95a9-05ff6d10cee6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:10.927265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-369a748e-1db0-45af-95a9-05ff6d10cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:11.101765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a748e-1db0-45af-95a9-05ff6d10cee6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:11.185153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:11.238378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:11.238998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:11.239277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:11.239549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:11.241249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:11.332508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:11.334174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda541d1-b784-4e29-acd4-9e94e2ea3d7a service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:11.353337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 692/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:13.329057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94316dd1-9f92-48a6-ad2e-fc165adae279 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:13.329712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94316dd1-9f92-48a6-ad2e-fc165adae279 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:13.329712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94316dd1-9f92-48a6-ad2e-fc165adae279 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:13.331845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 694/1386] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:12:13.337925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7620fd-3e05-4a48-b8ba-79c480c1d14c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:13.338448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7620fd-3e05-4a48-b8ba-79c480c1d14c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:13.338555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7620fd-3e05-4a48-b8ba-79c480c1d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:13.417374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0a7620fd-3e05-4a48-b8ba-79c480c1d14c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:13.418631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a7620fd-3e05-4a48-b8ba-79c480c1d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:13.454752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:13.524953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 693/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:13.819054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94316dd1-9f92-48a6-ad2e-fc165adae279 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:13.820552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-94316dd1-9f92-48a6-ad2e-fc165adae279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:13.921655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:14.015194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94316dd1-9f92-48a6-ad2e-fc165adae279 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:14.143463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:14.144345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:14.144767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:14.145205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:14.147638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:14.204971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:14.277512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:14.279408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6354ed8-d6af-4549-8311-0cd6cb734605 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:14.301408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 695/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:16.332291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d386-bfdf-416f-b7c8-6003b04dc8e1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:16.332799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d386-bfdf-416f-b7c8-6003b04dc8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:16.332910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d386-bfdf-416f-b7c8-6003b04dc8e1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:16.334438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 694/1389] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:16.341893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050ad8-1256-40ef-9ddd-3dabfc30baa2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:16.341893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050ad8-1256-40ef-9ddd-3dabfc30baa2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:16.341893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050ad8-1256-40ef-9ddd-3dabfc30baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:16.413691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a7050ad8-1256-40ef-9ddd-3dabfc30baa2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:16.415357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a7050ad8-1256-40ef-9ddd-3dabfc30baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:16.520300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 696/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:16.818897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d386-bfdf-416f-b7c8-6003b04dc8e1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:16.820406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2315d386-bfdf-416f-b7c8-6003b04dc8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:16.902289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207678e-8fe4-44a7-a0eb-a214b9a7912c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:16.902565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207678e-8fe4-44a7-a0eb-a214b9a7912c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:16.902838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207678e-8fe4-44a7-a0eb-a214b9a7912c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:16.904326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 697/1391] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:12:16.909642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545b098-fe3e-4510-9954-eea47dba038e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:16.909962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545b098-fe3e-4510-9954-eea47dba038e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:16.910230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545b098-fe3e-4510-9954-eea47dba038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:16.926852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:16.986258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a545b098-fe3e-4510-9954-eea47dba038e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:16.987499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a545b098-fe3e-4510-9954-eea47dba038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:16.995905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d386-bfdf-416f-b7c8-6003b04dc8e1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:17.013025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:17.103837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 698/1392] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:17.128782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:17.129381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:17.129654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:17.129946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:17.131517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:17.229657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:17.231373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba748933-dc1c-4bd6-bfef-f9d6392086eb service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:17.250643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 695/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:17.416207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eea04-3623-464b-9092-c83f1978e2f8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:17.416739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eea04-3623-464b-9092-c83f1978e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:17.416739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eea04-3623-464b-9092-c83f1978e2f8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:17.418164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 699/1394] 10.222.0.49 () {54 vars in 967 bytes} [Wed Aug 31 00:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:17.424360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f3b9-a89d-4c15-90c6-f0769eb102f8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:17.424938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f3b9-a89d-4c15-90c6-f0769eb102f8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:17.424938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f3b9-a89d-4c15-90c6-f0769eb102f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:17.453772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:17.510380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9998f3b9-a89d-4c15-90c6-f0769eb102f8 None None] MFA Rules not processed for user `cba449ceaf8746779958a1278e6d4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:17.511606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9998f3b9-a89d-4c15-90c6-f0769eb102f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:17.594261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 696/1395] 10.222.0.49 () {58 vars in 1064 bytes} [Wed Aug 31 00:12:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:17.602279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eea04-3623-464b-9092-c83f1978e2f8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:17.603780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-679eea04-3623-464b-9092-c83f1978e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:17.729916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:17.738375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eea04-3623-464b-9092-c83f1978e2f8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:17.816579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:17.817189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:17.817607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:17.817912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:17.819510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:17.946464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:17.948047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353522c-9bee-40c0-a497-7f6e5c22810a service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:17.967877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 700/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:18.750557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa97c-5f4c-4a91-a9d3-86e4dcf2de76 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:18.751059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa97c-5f4c-4a91-a9d3-86e4dcf2de76 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:18.751168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa97c-5f4c-4a91-a9d3-86e4dcf2de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:18.846395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-127fa97c-5f4c-4a91-a9d3-86e4dcf2de76 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:18.848614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-127fa97c-5f4c-4a91-a9d3-86e4dcf2de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:18.917875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:18.951727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 697/1397] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:12:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:19.001148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b2599-d95f-420f-b780-72a66c6124ee None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:19.001655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b2599-d95f-420f-b780-72a66c6124ee None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:19.001747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b2599-d95f-420f-b780-72a66c6124ee None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:19.004346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 701/1398] 10.222.0.49 () {54 vars in 943 bytes} [Wed Aug 31 00:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:19.011867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1b95-1862-45c0-8c0e-d609c342aef9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:19.012153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1b95-1862-45c0-8c0e-d609c342aef9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:19.012456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1b95-1862-45c0-8c0e-d609c342aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:19.092059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-35de1b95-1862-45c0-8c0e-d609c342aef9 None None] MFA Rules not processed for user `745d4cf142e24a7c9fb31af289f71fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:19.093342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-35de1b95-1862-45c0-8c0e-d609c342aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:19.215656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 698/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Wed Aug 31 00:12:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:19.233448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b2599-d95f-420f-b780-72a66c6124ee None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:19.233448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5c8b2599-d95f-420f-b780-72a66c6124ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:19.240904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b5129-dd67-4b4e-b738-ba3ee7f5b355 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:19.241181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b5129-dd67-4b4e-b738-ba3ee7f5b355 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:19.241448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b5129-dd67-4b4e-b738-ba3ee7f5b355 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:19.242996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 699/1400] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:12:19.248688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:19.248974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:19.249247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:19.263344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:19.300955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:19.327494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:19.328996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:19.399955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b2599-d95f-420f-b780-72a66c6124ee None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:19.438438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 700/1401] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:19.523728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:19.524682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:19.525153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:19.525647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:19.527506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:19.535930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:19.616918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:19.618588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7788fe-a4d5-4df1-a361-7b7fad52b394 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:19.631291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 702/1402] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:12:19.734475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:19.736132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:19.934154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38e9a9-d92c-49c6-a705-fe4c0a744190 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:19.939029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:20.093003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:20.093614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:20.093931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:20.094203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:20.095789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:20.221387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:20.223069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc503e-3bc8-44fa-b873-1dce82c0f892 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:20.244665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 701/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:22.246877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635780e2-668a-4364-b2c8-28b6e6c0578c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:22.247381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635780e2-668a-4364-b2c8-28b6e6c0578c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:22.247475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635780e2-668a-4364-b2c8-28b6e6c0578c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:22.248932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 703/1404] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:22.254708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4dd49-b0aa-4e10-835e-9a22d8a4a8e6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:22.255580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4dd49-b0aa-4e10-835e-9a22d8a4a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:22.256157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4dd49-b0aa-4e10-835e-9a22d8a4a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:22.276898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:22.339694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-51f4dd49-b0aa-4e10-835e-9a22d8a4a8e6 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:22.341259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-51f4dd49-b0aa-4e10-835e-9a22d8a4a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:22.471396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 702/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:22.761650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635780e2-668a-4364-b2c8-28b6e6c0578c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:22.763174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-635780e2-668a-4364-b2c8-28b6e6c0578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:22.934661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635780e2-668a-4364-b2c8-28b6e6c0578c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:22.937663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:23.068585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:23.068585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:23.068585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:23.068585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:23.069602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:23.167761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:23.169365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e646b9-9ec4-4f8e-84bd-31b46fcb2fa5 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:23.188389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 704/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:25.142560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ab52-ee76-4e7a-8b17-a2997a2db8e3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:25.143120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ab52-ee76-4e7a-8b17-a2997a2db8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:25.143120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473ab52-ee76-4e7a-8b17-a2997a2db8e3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:25.146214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 703/1407] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:12:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:25.149432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ce9c-623c-4eaf-8bf9-eb7480adc56f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:25.149883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ce9c-623c-4eaf-8bf9-eb7480adc56f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:25.150029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ce9c-623c-4eaf-8bf9-eb7480adc56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:25.161622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:25.221379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6710ce9c-623c-4eaf-8bf9-eb7480adc56f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:25.222648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6710ce9c-623c-4eaf-8bf9-eb7480adc56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:25.328396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 705/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:25.631653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ab52-ee76-4e7a-8b17-a2997a2db8e3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:25.633168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3473ab52-ee76-4e7a-8b17-a2997a2db8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:25.817329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:25.899096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473ab52-ee76-4e7a-8b17-a2997a2db8e3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:26.023534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:26.024135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:26.024410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:26.024676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:26.026276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:26.083018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:26.124664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:26.126307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f55cb-2bb4-4b05-8798-7b85529817a2 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:26.149834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 704/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:35.326416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=62 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:36.147157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=23 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:42.388231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92ea77-b716-4b9a-9799-7b9a1163ceb6 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:42.388789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92ea77-b716-4b9a-9799-7b9a1163ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:42.388789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92ea77-b716-4b9a-9799-7b9a1163ceb6 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:42.390155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 706/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed Aug 31 00:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:42.395206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bd87-cb37-421d-82ed-19d8a364232d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:42.395619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bd87-cb37-421d-82ed-19d8a364232d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:42.395750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bd87-cb37-421d-82ed-19d8a364232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:42.470356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-31b5bd87-cb37-421d-82ed-19d8a364232d None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:42.471554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-31b5bd87-cb37-421d-82ed-19d8a364232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:42.586476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 705/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 31 00:12:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:42.601264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc566370-c4ba-48a9-a5e3-169535dcd4b6 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:42.601547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc566370-c4ba-48a9-a5e3-169535dcd4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:42.601817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc566370-c4ba-48a9-a5e3-169535dcd4b6 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:42.603178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 707/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed Aug 31 00:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:42.607642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d35bb-5fc2-45f4-8d49-79987913615b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:42.607924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d35bb-5fc2-45f4-8d49-79987913615b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:42.608195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d35bb-5fc2-45f4-8d49-79987913615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:42.679045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:42.683182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b27d35bb-5fc2-45f4-8d49-79987913615b None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:42.684918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b27d35bb-5fc2-45f4-8d49-79987913615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:42.799320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 706/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 31 00:12:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:45.187824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c5af8-17e9-429a-8ad9-9401ccea2326 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:45.188898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c5af8-17e9-429a-8ad9-9401ccea2326 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:45.188898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c5af8-17e9-429a-8ad9-9401ccea2326 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:45.190200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:45.195499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a548f-6fc8-4dc2-8e19-b42ebcd71182 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:45.195937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a548f-6fc8-4dc2-8e19-b42ebcd71182 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:45.196047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a548f-6fc8-4dc2-8e19-b42ebcd71182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:45.261247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-478a548f-6fc8-4dc2-8e19-b42ebcd71182 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:45.262477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-478a548f-6fc8-4dc2-8e19-b42ebcd71182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:45.317578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:45.358976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:45.644794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c5af8-17e9-429a-8ad9-9401ccea2326 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:45.646334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-807c5af8-17e9-429a-8ad9-9401ccea2326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:45.790369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c5af8-17e9-429a-8ad9-9401ccea2326 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:45.863973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:45.910009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:45.910545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:45.910824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:45.911097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:45.912697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:45.999326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:46.001434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af227bab-334a-4940-a84c-9c89bfdbff3d service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:46.019390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 709/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:12:46.903706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feefb99-b28f-4753-bb6b-8bb97c485ec8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:46.904248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feefb99-b28f-4753-bb6b-8bb97c485ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:46.904248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feefb99-b28f-4753-bb6b-8bb97c485ec8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:46.905578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:46.911240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e46665-f6a1-4d4c-8e6f-36f8f614a274 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:46.911661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e46665-f6a1-4d4c-8e6f-36f8f614a274 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:46.911773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e46665-f6a1-4d4c-8e6f-36f8f614a274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:46.990754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-20e46665-f6a1-4d4c-8e6f-36f8f614a274 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:46.991951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-20e46665-f6a1-4d4c-8e6f-36f8f614a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.018686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:47.089063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:47.245280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feefb99-b28f-4753-bb6b-8bb97c485ec8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:47.247415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2feefb99-b28f-4753-bb6b-8bb97c485ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.393500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feefb99-b28f-4753-bb6b-8bb97c485ec8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:47.432371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:47.505135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:47.505740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:47.506044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:47.506317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:47.507906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.603709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:47.605297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0742b2-69aa-4208-8068-c0bd4d726748 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:47.622793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 709/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:48.502521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb210677-e4e8-4508-ac47-128c3aec157b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:48.503050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb210677-e4e8-4508-ac47-128c3aec157b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:48.503050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb210677-e4e8-4508-ac47-128c3aec157b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:48.504321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:48.509125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b1aa-3a01-4c2f-b81e-98bdd1fec894 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:48.509578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b1aa-3a01-4c2f-b81e-98bdd1fec894 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:48.509706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7b1aa-3a01-4c2f-b81e-98bdd1fec894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:48.563031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:48.585496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7fe7b1aa-3a01-4c2f-b81e-98bdd1fec894 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:48.586717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7fe7b1aa-3a01-4c2f-b81e-98bdd1fec894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:48.681019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:48.834665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb210677-e4e8-4508-ac47-128c3aec157b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:48.836091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bb210677-e4e8-4508-ac47-128c3aec157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:48.981952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb210677-e4e8-4508-ac47-128c3aec157b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:48.994328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:49.092622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:49.093143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:49.093413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:49.093672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:49.095786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:49.182322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:49.183896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0f255-acf6-4b94-ac45-4deb64551c85 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:49.201644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 712/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:50.068206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc1f6-1d08-498c-bc07-8c83193fc993 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.068756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc1f6-1d08-498c-bc07-8c83193fc993 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.068756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc1f6-1d08-498c-bc07-8c83193fc993 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.070117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:50.075082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e591a-2286-49af-bf75-2aae88142d1e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.075486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e591a-2286-49af-bf75-2aae88142d1e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.075634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e591a-2286-49af-bf75-2aae88142d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.096075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:50.151660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e58e591a-2286-49af-bf75-2aae88142d1e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:50.152792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e58e591a-2286-49af-bf75-2aae88142d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:50.249130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:50.399652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc1f6-1d08-498c-bc07-8c83193fc993 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:50.401156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-987fc1f6-1d08-498c-bc07-8c83193fc993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:50.508895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:50.546249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc1f6-1d08-498c-bc07-8c83193fc993 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:50.655006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:50.655600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.655873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.656138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.658233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:50.734515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:50.748153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:50.749746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e82fc4-7a04-4ed9-9757-a6ccd4ac643b service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:50.767671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 712/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:51.646124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b37887-e9e4-461d-9baa-986db6a5a18c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:51.646700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b37887-e9e4-461d-9baa-986db6a5a18c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:51.646700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b37887-e9e4-461d-9baa-986db6a5a18c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:51.648034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:51.653094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794b1f-704f-4bc0-8096-ca2a4111bd50 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:51.653527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794b1f-704f-4bc0-8096-ca2a4111bd50 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:51.653667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794b1f-704f-4bc0-8096-ca2a4111bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:51.732126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c3794b1f-704f-4bc0-8096-ca2a4111bd50 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:51.733343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c3794b1f-704f-4bc0-8096-ca2a4111bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:51.826508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:51.978115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b37887-e9e4-461d-9baa-986db6a5a18c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:51.979645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b5b37887-e9e4-461d-9baa-986db6a5a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:52.067100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:52.127905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b37887-e9e4-461d-9baa-986db6a5a18c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:52.238124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:52.238655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:52.238931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:52.239200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:52.240826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:52.288806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:52.330430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:52.332100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0286f-47dc-4d07-9a26-1fca136d3ca7 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:52.349631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 715/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:53.148864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde37f4-fa93-487f-a64d-675d2b8b7475 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:53.149417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde37f4-fa93-487f-a64d-675d2b8b7475 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:53.149417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde37f4-fa93-487f-a64d-675d2b8b7475 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:53.150691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:53.155492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8af1bb-9d9d-4990-86c6-803f8d9fde68 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:53.155889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8af1bb-9d9d-4990-86c6-803f8d9fde68 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:53.156031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8af1bb-9d9d-4990-86c6-803f8d9fde68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:53.230092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0e8af1bb-9d9d-4990-86c6-803f8d9fde68 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:53.231279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0e8af1bb-9d9d-4990-86c6-803f8d9fde68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:53.323790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:53.472662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde37f4-fa93-487f-a64d-675d2b8b7475 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:53.474141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9fde37f4-fa93-487f-a64d-675d2b8b7475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:53.521647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:53.619466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde37f4-fa93-487f-a64d-675d2b8b7475 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:53.733854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:53.734503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:53.734780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:53.735905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:53.737487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:53.744400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:53.826259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:53.827839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691e564-e156-4a60-ae9c-e731980e0318 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:53.846376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 715/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:54.656955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac2c-7862-41f1-9c7c-6f380a7bf853 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:54.657530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac2c-7862-41f1-9c7c-6f380a7bf853 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:54.657530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac2c-7862-41f1-9c7c-6f380a7bf853 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:54.658890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:54.663672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9ef85-edd2-4339-ab03-61b3c7f66b6c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:54.664071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9ef85-edd2-4339-ab03-61b3c7f66b6c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:54.664222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9ef85-edd2-4339-ab03-61b3c7f66b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:54.743797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-30f9ef85-edd2-4339-ab03-61b3c7f66b6c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:54.745017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-30f9ef85-edd2-4339-ab03-61b3c7f66b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:54.811688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:54.841147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:54.993948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac2c-7862-41f1-9c7c-6f380a7bf853 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:54.995465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dc05ac2c-7862-41f1-9c7c-6f380a7bf853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:55.013243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:55.140563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac2c-7862-41f1-9c7c-6f380a7bf853 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:55.226489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:55.253531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:55.254090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:55.254374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:55.254646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:55.256232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:55.344123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:55.345737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66da97b-d250-4931-8803-874229a6cec6 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:55.363952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 718/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:56.167025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c742e1-2bbc-496a-83ed-832a067d91ec None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:56.167537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c742e1-2bbc-496a-83ed-832a067d91ec None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:56.167537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c742e1-2bbc-496a-83ed-832a067d91ec None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:56.168823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:56.174513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da90c04-a838-4602-91cb-b26daa446081 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:56.174969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da90c04-a838-4602-91cb-b26daa446081 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:56.175082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da90c04-a838-4602-91cb-b26daa446081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:56.249526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7da90c04-a838-4602-91cb-b26daa446081 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:56.251351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7da90c04-a838-4602-91cb-b26daa446081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:56.292373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:56.346874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:56.495195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c742e1-2bbc-496a-83ed-832a067d91ec None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:56.496708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-85c742e1-2bbc-496a-83ed-832a067d91ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:56.638737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c742e1-2bbc-496a-83ed-832a067d91ec None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:56.692216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:56.751209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:56.751790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:56.752070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:56.752342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:56.754028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:56.841299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:56.842944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fdaf3-e90e-4c54-8d41-764a4e8e7601 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:56.861082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 718/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:57.660399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6840d-1f0e-4f42-aa6f-14bfb914f68b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:57.660962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6840d-1f0e-4f42-aa6f-14bfb914f68b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:57.660962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6840d-1f0e-4f42-aa6f-14bfb914f68b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:57.662338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:57.667368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588c46-acb0-43bc-8434-ae0f6e9762fb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:57.667812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588c46-acb0-43bc-8434-ae0f6e9762fb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:57.667912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588c46-acb0-43bc-8434-ae0f6e9762fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:57.743514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cf588c46-acb0-43bc-8434-ae0f6e9762fb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:57.744723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cf588c46-acb0-43bc-8434-ae0f6e9762fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:57.746733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:57.841233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:57.992297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6840d-1f0e-4f42-aa6f-14bfb914f68b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:57.993834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cfe6840d-1f0e-4f42-aa6f-14bfb914f68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:58.138702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6840d-1f0e-4f42-aa6f-14bfb914f68b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:58.165059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:58.250578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:58.251102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:58.251380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:58.251649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:58.253244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:58.342645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:58.344263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8aff6-c83f-49c0-b41c-16c4f45ec580 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:58.362446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 721/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:00.196523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b61b-a2e4-451e-9de4-047ad23cfb2e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.197035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b61b-a2e4-451e-9de4-047ad23cfb2e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.197035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b61b-a2e4-451e-9de4-047ad23cfb2e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:00.198357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:00.203573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5967c8-7334-47e2-94eb-1777f3eabc58 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.204594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5967c8-7334-47e2-94eb-1777f3eabc58 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.204769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5967c8-7334-47e2-94eb-1777f3eabc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:00.244733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:00.271237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7b5967c8-7334-47e2-94eb-1777f3eabc58 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:00.272444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7b5967c8-7334-47e2-94eb-1777f3eabc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:00.365852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:00.650543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49b61b-a2e4-451e-9de4-047ad23cfb2e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:00.652078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dc49b61b-a2e4-451e-9de4-047ad23cfb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:00.756330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49b61b-a2e4-451e-9de4-047ad23cfb2e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:00.787257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:00.828522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:00.829165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.829478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.829753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:00.831421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:00.939598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:00.940957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e2d25-ddb8-4aa1-ae14-8baea7b95d2c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:00.958757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 721/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:03.003032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4568-f320-4e01-b053-c7b7ba532913 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:03.003625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4568-f320-4e01-b053-c7b7ba532913 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:03.003625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe4568-f320-4e01-b053-c7b7ba532913 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:03.004914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:03.010392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca066-10d0-4318-9b11-e6a7e8b0a4ed None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:03.010798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca066-10d0-4318-9b11-e6a7e8b0a4ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:03.010940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca066-10d0-4318-9b11-e6a7e8b0a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:03.078766 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7b8ca066-10d0-4318-9b11-e6a7e8b0a4ed None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:03.080022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7b8ca066-10d0-4318-9b11-e6a7e8b0a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:03.092594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:03.174997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:03.456585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe4568-f320-4e01-b053-c7b7ba532913 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:03.458180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cbbe4568-f320-4e01-b053-c7b7ba532913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:03.564360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe4568-f320-4e01-b053-c7b7ba532913 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:03.575943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:03.636447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:03.637046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:03.637320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:03.637588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:03.639303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:03.744961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:03.746429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137c72e-87e0-45f8-8d9a-af433531ab72 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:03.763991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 724/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:05.949418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997313e-5cf8-4da9-afb2-2e25e18557ee None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:05.949975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997313e-5cf8-4da9-afb2-2e25e18557ee None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:05.949975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997313e-5cf8-4da9-afb2-2e25e18557ee None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:05.951335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:05.957034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f15fe-4b4e-44f5-91ab-4000753a3e24 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:05.957415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f15fe-4b4e-44f5-91ab-4000753a3e24 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:05.957583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f15fe-4b4e-44f5-91ab-4000753a3e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:06.005826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:06.023865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-284f15fe-4b4e-44f5-91ab-4000753a3e24 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:06.025074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-284f15fe-4b4e-44f5-91ab-4000753a3e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:06.119180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:06.402877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997313e-5cf8-4da9-afb2-2e25e18557ee None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:06.404420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5997313e-5cf8-4da9-afb2-2e25e18557ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:06.505620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997313e-5cf8-4da9-afb2-2e25e18557ee None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:06.545504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:06.579489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:06.580111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:06.580386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:06.580655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:06.582288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:06.688255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:06.689629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc383-b1b1-4c31-8122-cd45df34d1e7 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:06.707617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 724/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:08.758578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf3f9-8f10-4570-938c-a1828b498e23 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:08.759119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf3f9-8f10-4570-938c-a1828b498e23 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:08.759228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf3f9-8f10-4570-938c-a1828b498e23 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:08.760552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:08.765945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd2742-b877-4d06-8a06-c890ae697bf1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:08.767030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd2742-b877-4d06-8a06-c890ae697bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:08.767130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd2742-b877-4d06-8a06-c890ae697bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:08.834044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e3cd2742-b877-4d06-8a06-c890ae697bf1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:08.835278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e3cd2742-b877-4d06-8a06-c890ae697bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:08.855777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:08.931315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:09.210824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf3f9-8f10-4570-938c-a1828b498e23 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:09.212360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e7ddf3f9-8f10-4570-938c-a1828b498e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:09.318363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf3f9-8f10-4570-938c-a1828b498e23 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:09.337698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.390431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:09.391030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:09.391322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:09.391592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:09.393235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:09.500649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:09.502118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ba38b-2440-4a9b-86a9-842f9c1697ab service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:09.520283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 727/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:11.489339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878cc1c-0e4a-46dc-9d64-030e7289cf57 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.489937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878cc1c-0e4a-46dc-9d64-030e7289cf57 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.489937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878cc1c-0e4a-46dc-9d64-030e7289cf57 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.491295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:11.496595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33bf76-187a-4171-a774-ba7d1ef50920 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.497012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33bf76-187a-4171-a774-ba7d1ef50920 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.497140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33bf76-187a-4171-a774-ba7d1ef50920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.559741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:11.562438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0e33bf76-187a-4171-a774-ba7d1ef50920 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:11.564166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0e33bf76-187a-4171-a774-ba7d1ef50920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:11.657461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:11.944611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878cc1c-0e4a-46dc-9d64-030e7289cf57 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:11.946182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8878cc1c-0e4a-46dc-9d64-030e7289cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.046838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878cc1c-0e4a-46dc-9d64-030e7289cf57 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:12.094217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:12.120837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:12.121374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:12.121649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:12.121950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:12.123530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.229621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:12.231117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95516eb5-926c-4308-af68-cceb0434a990 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:12.248444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 727/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:14.209186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfd8f-d2a7-41e4-b4cd-cf26ac05770a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:14.210126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfd8f-d2a7-41e4-b4cd-cf26ac05770a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:14.210418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadfd8f-d2a7-41e4-b4cd-cf26ac05770a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:14.211780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:14.218033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aea2c8-58b9-484e-aaab-0dbe863ed3de None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:14.218540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aea2c8-58b9-484e-aaab-0dbe863ed3de None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:14.218648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aea2c8-58b9-484e-aaab-0dbe863ed3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:14.284361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c4aea2c8-58b9-484e-aaab-0dbe863ed3de None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:14.285562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c4aea2c8-58b9-484e-aaab-0dbe863ed3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:14.314998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:14.380993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:14.667574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadfd8f-d2a7-41e4-b4cd-cf26ac05770a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:14.669197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9aadfd8f-d2a7-41e4-b4cd-cf26ac05770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:14.770390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadfd8f-d2a7-41e4-b4cd-cf26ac05770a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:14.798452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:14.845003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:14.845538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:14.845816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:14.846116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:14.847705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:14.954180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:14.955612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c0c51-c70f-4b47-a23b-24b6361ff18b service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:14.972825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 730/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:17.039576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34227202-acc3-4331-b087-70cb72106f52 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:17.040130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34227202-acc3-4331-b087-70cb72106f52 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:17.040130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34227202-acc3-4331-b087-70cb72106f52 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:17.041444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:17.046611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6d38-d1a0-487b-9027-9bddbad5488b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:17.047052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6d38-d1a0-487b-9027-9bddbad5488b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:17.047161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6d38-d1a0-487b-9027-9bddbad5488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:17.112283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ffbc6d38-d1a0-487b-9027-9bddbad5488b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:17.113499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ffbc6d38-d1a0-487b-9027-9bddbad5488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:17.121609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:17.209118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:17.496368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34227202-acc3-4331-b087-70cb72106f52 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:17.497920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-34227202-acc3-4331-b087-70cb72106f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:17.599298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34227202-acc3-4331-b087-70cb72106f52 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:17.653755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:17.672262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:17.672864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:17.673432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:17.673701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:17.675318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:17.787655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:17.789019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92d70-e41e-45a2-9b84-47cb4ac65041 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:17.808124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 730/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:19.739921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478598a-9f44-43d2-bf4e-884be4c9fa20 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:19.740495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478598a-9f44-43d2-bf4e-884be4c9fa20 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:19.740495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478598a-9f44-43d2-bf4e-884be4c9fa20 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:19.741790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:19.747053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f641-0fd5-44c5-9cf6-e27f5db84634 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:19.747443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f641-0fd5-44c5-9cf6-e27f5db84634 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:19.747596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f641-0fd5-44c5-9cf6-e27f5db84634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:19.812716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8043f641-0fd5-44c5-9cf6-e27f5db84634 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:19.814449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8043f641-0fd5-44c5-9cf6-e27f5db84634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:19.851779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:19.910193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:20.190862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478598a-9f44-43d2-bf4e-884be4c9fa20 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:20.192389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f478598a-9f44-43d2-bf4e-884be4c9fa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:20.295785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478598a-9f44-43d2-bf4e-884be4c9fa20 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:20.333652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:20.369930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:20.370532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:20.370809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:20.371081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:20.372667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:20.480019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:20.481454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d2dcd-7312-4d9f-9cab-02c3e4d9c031 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:20.499434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 733/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:22.413360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317beba-71a0-4e31-8cde-2f48246b8edc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:22.413937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317beba-71a0-4e31-8cde-2f48246b8edc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:22.413937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317beba-71a0-4e31-8cde-2f48246b8edc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:22.415711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:22.421130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a97aa-fb70-4a7f-b605-451144993445 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:22.421558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a97aa-fb70-4a7f-b605-451144993445 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:22.421675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a97aa-fb70-4a7f-b605-451144993445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:22.488666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2b4a97aa-fb70-4a7f-b605-451144993445 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:22.489885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2b4a97aa-fb70-4a7f-b605-451144993445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:22.507818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:22.590169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:22.876591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317beba-71a0-4e31-8cde-2f48246b8edc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:22.878180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9317beba-71a0-4e31-8cde-2f48246b8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:23.109915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317beba-71a0-4e31-8cde-2f48246b8edc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:23.175517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:23.182814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:23.183413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:23.183690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:23.183957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:23.185541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:23.290160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:23.291583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f87263-965a-4b3d-8ea3-5639cb695c81 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:23.309685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 733/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:25.211385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb643a4-39bc-4812-845c-491f55045c91 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:25.211911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb643a4-39bc-4812-845c-491f55045c91 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:25.211911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb643a4-39bc-4812-845c-491f55045c91 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:25.213240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:25.218325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc53eea-4a8d-40a1-aac8-358fcc833d56 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:25.218733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc53eea-4a8d-40a1-aac8-358fcc833d56 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:25.218859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc53eea-4a8d-40a1-aac8-358fcc833d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:25.284598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1bc53eea-4a8d-40a1-aac8-358fcc833d56 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:25.285918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1bc53eea-4a8d-40a1-aac8-358fcc833d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:25.333190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:25.380174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:25.665779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb643a4-39bc-4812-845c-491f55045c91 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:25.667456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3fb643a4-39bc-4812-845c-491f55045c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:25.776042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb643a4-39bc-4812-845c-491f55045c91 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:25.823893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:25.851046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:25.851650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:25.851931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:25.852208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:25.853798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:25.962206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:25.963580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7372024-fdfd-4306-9f99-56e6373f5bd5 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:25.981969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 736/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:35.378398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=22 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:35.979719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=66 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:45.592769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16353ce-c3e1-4b73-bd75-5bcfbd254b4c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:45.593335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16353ce-c3e1-4b73-bd75-5bcfbd254b4c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:45.593335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16353ce-c3e1-4b73-bd75-5bcfbd254b4c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:45.595285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 735/1471] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:45.600343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7903e5-ef75-4b68-8031-60a2388ab5be None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:45.600783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7903e5-ef75-4b68-8031-60a2388ab5be None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:45.600920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7903e5-ef75-4b68-8031-60a2388ab5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:45.665637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4d7903e5-ef75-4b68-8031-60a2388ab5be None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:45.666862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4d7903e5-ef75-4b68-8031-60a2388ab5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:45.764448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 737/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:46.058417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412a85-a14e-487d-b595-0288cb1281a2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:46.058701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412a85-a14e-487d-b595-0288cb1281a2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:46.058971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412a85-a14e-487d-b595-0288cb1281a2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:46.060271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 736/1473] 10.222.0.49 () {54 vars in 967 bytes} [Wed Aug 31 00:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:46.065424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0455-d59d-4e68-9ae8-787b02f68e22 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:46.065712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0455-d59d-4e68-9ae8-787b02f68e22 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:46.066022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0455-d59d-4e68-9ae8-787b02f68e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:46.139638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-173f0455-d59d-4e68-9ae8-787b02f68e22 None None] MFA Rules not processed for user `cba449ceaf8746779958a1278e6d4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:46.140780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-173f0455-d59d-4e68-9ae8-787b02f68e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:46.161291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:46.217118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 738/1474] 10.222.0.49 () {58 vars in 1064 bytes} [Wed Aug 31 00:13:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:46.224655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412a85-a14e-487d-b595-0288cb1281a2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:46.226177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-de412a85-a14e-487d-b595-0288cb1281a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:46.328945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412a85-a14e-487d-b595-0288cb1281a2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:46.399398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:46.399922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:46.400197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:46.400463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:46.402059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:46.454980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:46.514383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:46.515818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788f775-ec7c-4192-a88f-a0587ffcf42e service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:46.533694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 737/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:48.524864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe178-2339-4fd0-9930-0de7d10e6efc None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:48.525421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe178-2339-4fd0-9930-0de7d10e6efc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:48.525421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe178-2339-4fd0-9930-0de7d10e6efc None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:48.526822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 739/1476] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:48.532028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4efd4-5b81-42b2-86f6-5d0cf38e5cda None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:48.532711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4efd4-5b81-42b2-86f6-5d0cf38e5cda None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:48.532711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4efd4-5b81-42b2-86f6-5d0cf38e5cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:48.597916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f2d4efd4-5b81-42b2-86f6-5d0cf38e5cda None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:48.599122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f2d4efd4-5b81-42b2-86f6-5d0cf38e5cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:48.697670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 738/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:48.972676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fe178-2339-4fd0-9930-0de7d10e6efc None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:48.974283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-514fe178-2339-4fd0-9930-0de7d10e6efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:49.097854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fe178-2339-4fd0-9930-0de7d10e6efc None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:49.145347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:49.189619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:49.190247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:49.190524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:49.190878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:49.191513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:49.193289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:13:49.193289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:13:49.193289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:13:49.194495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54c8a7-ed17-42df-9228-42901ae8bdb0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:49.213042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 740/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 31 00:13:48 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:13:51.115050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7662083-51a8-4cc5-8729-27f43c8b2bc6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:51.115602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7662083-51a8-4cc5-8729-27f43c8b2bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:51.115602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7662083-51a8-4cc5-8729-27f43c8b2bc6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:51.116912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 739/1479] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:51.122126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1094-496a-4604-948b-8491c311eb82 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:51.122566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1094-496a-4604-948b-8491c311eb82 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:51.122680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1094-496a-4604-948b-8491c311eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:51.190820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f8be1094-496a-4604-948b-8491c311eb82 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:51.192034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f8be1094-496a-4604-948b-8491c311eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:51.298151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 741/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:51.587341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7662083-51a8-4cc5-8729-27f43c8b2bc6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:51.588887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d7662083-51a8-4cc5-8729-27f43c8b2bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:51.598917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:51.735474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7662083-51a8-4cc5-8729-27f43c8b2bc6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:51.811926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:51.844142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:51.844671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:51.844943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:51.845208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:51.846813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:51.936683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:51.938819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c990a29-20b6-4636-ab7d-04d38406f5f4 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:51.957335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 740/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:54.056897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1274d-47ff-499a-8274-44cf7bc4ce74 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.057468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1274d-47ff-499a-8274-44cf7bc4ce74 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.057468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1274d-47ff-499a-8274-44cf7bc4ce74 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.058820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 742/1482] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:54.064311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b54da-dad9-48f7-b4e3-82e7a0cc7291 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.064708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b54da-dad9-48f7-b4e3-82e7a0cc7291 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.064865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b54da-dad9-48f7-b4e3-82e7a0cc7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.129503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-eb8b54da-dad9-48f7-b4e3-82e7a0cc7291 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:54.130656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eb8b54da-dad9-48f7-b4e3-82e7a0cc7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:54.181776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:54.234825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 741/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:54.525700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1274d-47ff-499a-8274-44cf7bc4ce74 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:54.527264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-67f1274d-47ff-499a-8274-44cf7bc4ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:54.551041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:54.639434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1274d-47ff-499a-8274-44cf7bc4ce74 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:54.711619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:54.712245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.712517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.712781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.714391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:54.786523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:54.822043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:54.823498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d0525-1a44-4fdc-a0b5-87d278253856 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:54.840957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 743/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:56.795184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477bdb-9a8b-44ba-bfad-907ad0eb7410 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:56.795808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477bdb-9a8b-44ba-bfad-907ad0eb7410 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:56.795808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477bdb-9a8b-44ba-bfad-907ad0eb7410 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:56.797621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 742/1485] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:56.803131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a349ba-3804-46ba-9b9d-8ef8665819dc None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:56.803557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a349ba-3804-46ba-9b9d-8ef8665819dc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:56.803675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a349ba-3804-46ba-9b9d-8ef8665819dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:56.869616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-21a349ba-3804-46ba-9b9d-8ef8665819dc None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:56.870852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-21a349ba-3804-46ba-9b9d-8ef8665819dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:56.977154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 744/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:57.272522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477bdb-9a8b-44ba-bfad-907ad0eb7410 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:57.274081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-50477bdb-9a8b-44ba-bfad-907ad0eb7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:57.379535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477bdb-9a8b-44ba-bfad-907ad0eb7410 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:57.450117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:57.452183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:57.453021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:57.453465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:57.453925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:57.455742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:57.563685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:57.565033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a099e35-9696-49e2-a1bb-acb7c377268e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:57.582976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 743/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:59.592626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb7f33-31a5-4023-8a8d-6784b3009d36 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:59.593246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb7f33-31a5-4023-8a8d-6784b3009d36 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:59.593246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb7f33-31a5-4023-8a8d-6784b3009d36 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:59.594597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 745/1488] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:59.599920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960faf-0206-4f69-b6fa-4c7cae9d8b02 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:59.600373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960faf-0206-4f69-b6fa-4c7cae9d8b02 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:59.600478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960faf-0206-4f69-b6fa-4c7cae9d8b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:59.664551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-03960faf-0206-4f69-b6fa-4c7cae9d8b02 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:59.665753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-03960faf-0206-4f69-b6fa-4c7cae9d8b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:59.716881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:59.761795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 744/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:00.051258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb7f33-31a5-4023-8a8d-6784b3009d36 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:00.052802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c4bb7f33-31a5-4023-8a8d-6784b3009d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:00.088483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:00.154581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb7f33-31a5-4023-8a8d-6784b3009d36 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:00.227334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:00.227934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:00.228209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:00.228478 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:00.230085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:00.309692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:00.338230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:00.339674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04b7b0-62d2-44e3-ac47-84395a8f9251 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:00.357668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 746/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:02.506914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871775-03c5-4011-96d1-ffa3f01c0c31 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.507438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871775-03c5-4011-96d1-ffa3f01c0c31 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.507438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871775-03c5-4011-96d1-ffa3f01c0c31 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.508770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 745/1491] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 31 00:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:02.513817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c36e-ba4d-414d-a997-052b9f7a8c84 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.514264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c36e-ba4d-414d-a997-052b9f7a8c84 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.514385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c36e-ba4d-414d-a997-052b9f7a8c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.583240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-52d9c36e-ba4d-414d-a997-052b9f7a8c84 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:02.584357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-52d9c36e-ba4d-414d-a997-052b9f7a8c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.684531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 747/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:02.981085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871775-03c5-4011-96d1-ffa3f01c0c31 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:02.982654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4871775-03c5-4011-96d1-ffa3f01c0c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:03.085909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871775-03c5-4011-96d1-ffa3f01c0c31 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:03.157726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:03.158281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:03.158561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:03.158830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:03.160410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:03.169263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:03.269944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:03.271412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3f54d-37ca-40df-8f16-21fe34f0d151 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:03.289545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 746/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:12.682826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=82 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:13.287229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=50 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.249399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.249880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.249979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.325134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:15.326360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:15.425243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 748/1494] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:15.433442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.433985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.434100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.508189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:15.509420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:15.603853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 747/1495] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:15.609044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.610311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:15.621609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f36ff-8229-4814-bdd3-d15e481d2ca9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.681470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.714612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.715204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.715476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.715740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.716364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:15.716658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:15.717656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:15.717656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:15:15.717656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:15:15.718575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:15.729249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 749/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:15.738131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.747123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d8c80-b170-4b80-ad85-8b33aeb76a42 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.808523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.842387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.842992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.843270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.843540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.844160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:15.845954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:15.845954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:15:15.845954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:15:15.847154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:15.902093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 748/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:15:15 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:15:15.906802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.908309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:15.941102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35d20-3e88-4972-a440-b1bdc54aae66 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.034714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.035314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.035590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.035859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.036487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.037487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:16.037487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:15:16.037487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:15:16.038795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.080324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 750/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:15:15 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:16.084552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.086119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.146762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735821-5a6e-462c-ab94-8d202eb3ce08 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.229490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.241705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050917d-c876-4490-a518-883551b97769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.242338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050917d-c876-4490-a518-883551b97769 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.242617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050917d-c876-4490-a518-883551b97769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.242878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050917d-c876-4490-a518-883551b97769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.243505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050917d-c876-4490-a518-883551b97769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.244496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-0050917d-c876-4490-a518-883551b97769 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:16.244496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:15:16.244496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:15:16.245376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050917d-c876-4490-a518-883551b97769 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.257353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 749/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:16.261380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.262969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.274860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8916f3-635d-4faf-bd36-5a73c9ff5bfb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.300146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.369501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.370131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.370411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.370680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.371311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.372318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:16.372318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:15:16.372318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:15:16.373207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d7b8c-9341-4a7a-9f39-f4f3d74c2f82 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.385780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 751/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:16.390088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050917d-c876-4490-a518-883551b97769 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.391618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0050917d-c876-4490-a518-883551b97769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.423932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050917d-c876-4490-a518-883551b97769 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.518061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.518711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.518972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.519239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] PATH_INFO: `/v3/projects/a11f7d94177d4552b660ff7b732da48f/users/0c031691c7ee4bd7b4fab87a7ee9a1fa/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.540150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11f7d94177d4552b660ff7b732da48f, user_id=0c031691c7ee4bd7b4fab87a7ee9a1fa, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.541168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:16.541168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:15:16.541168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:15:16.543224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6acc1a-85fa-44f0-900e-c9ff4f2ce6ef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.567956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 750/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:15:16 2022] PUT /identity/v3/projects/a11f7d94177d4552b660ff7b732da48f/users/0c031691c7ee4bd7b4fab87a7ee9a1fa/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:16.580551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628a1d-4517-458b-9b06-9588acc6ead6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.580838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628a1d-4517-458b-9b06-9588acc6ead6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.581112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628a1d-4517-458b-9b06-9588acc6ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.637544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5b628a1d-4517-458b-9b06-9588acc6ead6 None None] MFA Rules not processed for user `0c031691c7ee4bd7b4fab87a7ee9a1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:16.638774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5b628a1d-4517-458b-9b06-9588acc6ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.714592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 752/1502] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:16.728184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95eb66-9a26-407b-b0ca-b865ca496dd2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.728467 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95eb66-9a26-407b-b0ca-b865ca496dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.728739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95eb66-9a26-407b-b0ca-b865ca496dd2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.730103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 751/1503] 10.222.0.49 () {54 vars in 964 bytes} [Wed Aug 31 00:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:16.735454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8cff-cf4a-4a30-91e4-b5a91b5ef998 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.735735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8cff-cf4a-4a30-91e4-b5a91b5ef998 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.736003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8cff-cf4a-4a30-91e4-b5a91b5ef998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.765900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.809490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ea7b8cff-cf4a-4a30-91e4-b5a91b5ef998 None None] MFA Rules not processed for user `f2440b4168f446639c4dd3761ea57438`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:16.810689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ea7b8cff-cf4a-4a30-91e4-b5a91b5ef998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.888025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 753/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Aug 31 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:16.896235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95eb66-9a26-407b-b0ca-b865ca496dd2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.897736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc95eb66-9a26-407b-b0ca-b865ca496dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.947439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.000500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95eb66-9a26-407b-b0ca-b865ca496dd2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:17.078809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:17.079398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.079671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.079938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.081507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.175179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:17.176529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:17.179906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.193515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 752/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:17.238450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd591-fc3c-4c20-a20c-4789e9f1def5 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.238735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd591-fc3c-4c20-a20c-4789e9f1def5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.239008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd591-fc3c-4c20-a20c-4789e9f1def5 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.240297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 754/1506] 10.222.0.49 () {52 vars in 830 bytes} [Wed Aug 31 00:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:17.243850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:17.245069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.343673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ebcd-9004-429a-a0e2-7da92ee4e792 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:17.440980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:17.441527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.441802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.442106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] PATH_INFO: `/v3/users/0c031691c7ee4bd7b4fab87a7ee9a1fa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.454408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c031691c7ee4bd7b4fab87a7ee9a1fa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:17.455420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:17.455420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:15:17.455420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:15:17.456627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:17.465869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.525613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c031691c7ee4bd7b4fab87a7ee9a1fa'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:17.526317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c031691c7ee4bd7b4fab87a7ee9a1fa'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:17.526571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c031691c7ee4bd7b4fab87a7ee9a1fa'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:17.548281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c031691c7ee4bd7b4fab87a7ee9a1fa'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:17.557550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c031691c7ee4bd7b4fab87a7ee9a1fa'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:17.577454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 753/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:15:17 2022] DELETE /identity/v3/users/0c031691c7ee4bd7b4fab87a7ee9a1fa => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:17.581997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.582480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.582614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.638014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:17.639802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.714935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.727759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 755/1508] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:17.738463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:17.739672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.838627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb7837-6f02-42ef-a57e-14d54c3301f0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:17.894783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.915391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:17.916001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.916275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.916544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.918149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:18.024165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:18.025612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaf9be-e102-46eb-a17d-14f55862cf38 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:18.043614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 754/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:18.381616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.382889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:18.396559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6ae7-c57d-449f-89fa-6fd247e9a77e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:18.610720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:18.611502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.611502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.611742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] PATH_INFO: `/v3/projects/a11f7d94177d4552b660ff7b732da48f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.622184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11f7d94177d4552b660ff7b732da48f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:18.623207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:18.623207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:15:18.623207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:15:18.625026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:18.690623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11f7d94177d4552b660ff7b732da48f', 'request_id': 'req-3ed4dbc5-4017-439d-bedb-73d4d36b084a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:18.710966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11f7d94177d4552b660ff7b732da48f', 'request_id': 'req-3ed4dbc5-4017-439d-bedb-73d4d36b084a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:18.716859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11f7d94177d4552b660ff7b732da48f', 'request_id': 'req-3ed4dbc5-4017-439d-bedb-73d4d36b084a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:18.743490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] The token cache is being invalidate because project a11f7d94177d4552b660ff7b732da48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:15:18.743783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:18.744213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3ed4dbc5-4017-439d-bedb-73d4d36b084a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:15:18.745613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 756/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:15:18 2022] DELETE /identity/v3/projects/a11f7d94177d4552b660ff7b732da48f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:28.041359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=62 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.741433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:53.192187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab46a-9676-4b7b-8893-ef00ad318ede None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.192764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab46a-9676-4b7b-8893-ef00ad318ede None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.192764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab46a-9676-4b7b-8893-ef00ad318ede None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.194005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:53.199405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837701df-fad3-4eec-99e8-cd6e4dadc0df None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.199817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837701df-fad3-4eec-99e8-cd6e4dadc0df None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.199956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837701df-fad3-4eec-99e8-cd6e4dadc0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.279134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-837701df-fad3-4eec-99e8-cd6e4dadc0df None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:53.280340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-837701df-fad3-4eec-99e8-cd6e4dadc0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:53.382421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:53.547550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab46a-9676-4b7b-8893-ef00ad318ede None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:53.549651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b9aab46a-9676-4b7b-8893-ef00ad318ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:53.670250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab46a-9676-4b7b-8893-ef00ad318ede None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:53.675924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4382f83-234f-454b-9917-2484e17506cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:53.676521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382f83-234f-454b-9917-2484e17506cd service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.676802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382f83-234f-454b-9917-2484e17506cd service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.677077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382f83-234f-454b-9917-2484e17506cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.684924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4382f83-234f-454b-9917-2484e17506cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:53.686542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4382f83-234f-454b-9917-2484e17506cd service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:53.695718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 756/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:54.528950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2bd8-c4a3-4057-ba36-ce8f47eeaf44 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.529470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2bd8-c4a3-4057-ba36-ce8f47eeaf44 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.529470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2bd8-c4a3-4057-ba36-ce8f47eeaf44 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.530793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:54.535557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef51e-005d-46ac-a2aa-3e948d4d5c98 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.535955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef51e-005d-46ac-a2aa-3e948d4d5c98 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.536103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef51e-005d-46ac-a2aa-3e948d4d5c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.555956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2e7ef51e-005d-46ac-a2aa-3e948d4d5c98 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:54.557150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2e7ef51e-005d-46ac-a2aa-3e948d4d5c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:54.565523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:54.714024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2bd8-c4a3-4057-ba36-ce8f47eeaf44 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.727917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2bd8-c4a3-4057-ba36-ce8f47eeaf44 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:54.733812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1ebb-a7d8-4fa2-865e-a95af112c812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:54.734421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ebb-a7d8-4fa2-865e-a95af112c812 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.734693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ebb-a7d8-4fa2-865e-a95af112c812 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.734961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ebb-a7d8-4fa2-865e-a95af112c812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.742730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1ebb-a7d8-4fa2-865e-a95af112c812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:54.744291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1ebb-a7d8-4fa2-865e-a95af112c812 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:54.753860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 759/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:56.844189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa81e-f009-4153-a3a2-f06981e67375 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.844788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa81e-f009-4153-a3a2-f06981e67375 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.844788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa81e-f009-4153-a3a2-f06981e67375 None None] PATH_INFO: `/v3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.846037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 758/1517] 10.222.0.57 () {54 vars in 925 bytes} [Wed Aug 31 00:16:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:56.853461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c30ff-9918-4df8-9f3d-b0422704b364 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.853921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c30ff-9918-4df8-9f3d-b0422704b364 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.854045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c30ff-9918-4df8-9f3d-b0422704b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.913282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-377c30ff-9918-4df8-9f3d-b0422704b364 None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:56.914498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-377c30ff-9918-4df8-9f3d-b0422704b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:56.931253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:56.985926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 760/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Aug 31 00:16:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:04.551115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=56 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.964747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ac20-61e6-45dc-86ec-c6dd89aeae97 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.965389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ac20-61e6-45dc-86ec-c6dd89aeae97 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.965389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ac20-61e6-45dc-86ec-c6dd89aeae97 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.966698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 759/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:05.971480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f81d4-9edc-497d-83b6-c8f60ed13fb4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.971913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f81d4-9edc-497d-83b6-c8f60ed13fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.972019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f81d4-9edc-497d-83b6-c8f60ed13fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.991586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1e2f81d4-9edc-497d-83b6-c8f60ed13fb4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:05.992771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1e2f81d4-9edc-497d-83b6-c8f60ed13fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.001381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 761/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:06.154512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1ac20-61e6-45dc-86ec-c6dd89aeae97 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.169230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1ac20-61e6-45dc-86ec-c6dd89aeae97 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.174570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bc10f-6494-4761-8fda-b323f897d0f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.175416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bc10f-6494-4761-8fda-b323f897d0f0 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.175695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bc10f-6494-4761-8fda-b323f897d0f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.175962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bc10f-6494-4761-8fda-b323f897d0f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.183880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bc10f-6494-4761-8fda-b323f897d0f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.185447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bc10f-6494-4761-8fda-b323f897d0f0 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.194792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 760/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:07.004783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc648cf-01ef-4a21-98ff-0419eed374fe None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.005380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc648cf-01ef-4a21-98ff-0419eed374fe None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.005380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc648cf-01ef-4a21-98ff-0419eed374fe None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.006805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:07.012813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297b47-ab88-4f7d-afa7-1aa960cd9a67 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.013302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297b47-ab88-4f7d-afa7-1aa960cd9a67 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.013403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297b47-ab88-4f7d-afa7-1aa960cd9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.033624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e1297b47-ab88-4f7d-afa7-1aa960cd9a67 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:07.036733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1297b47-ab88-4f7d-afa7-1aa960cd9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:07.045855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:07.199244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc648cf-01ef-4a21-98ff-0419eed374fe None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:07.213631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc648cf-01ef-4a21-98ff-0419eed374fe None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:07.219580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a30000-a4b9-4244-b727-4a1b983f3ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:07.220172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30000-a4b9-4244-b727-4a1b983f3ca0 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.220449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30000-a4b9-4244-b727-4a1b983f3ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.220720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30000-a4b9-4244-b727-4a1b983f3ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.229157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a30000-a4b9-4244-b727-4a1b983f3ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:07.231490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a30000-a4b9-4244-b727-4a1b983f3ca0 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:07.241156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 763/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:07.471853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379f96e-91ec-4aed-bc9b-8f85aa3171a1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.472063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379f96e-91ec-4aed-bc9b-8f85aa3171a1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.472322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379f96e-91ec-4aed-bc9b-8f85aa3171a1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.473656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 762/1525] 10.222.0.49 () {54 vars in 961 bytes} [Wed Aug 31 00:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:07.478899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253dce2-642e-4197-9c56-b4e8b871544a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.479184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253dce2-642e-4197-9c56-b4e8b871544a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.479463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253dce2-642e-4197-9c56-b4e8b871544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.498112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f253dce2-642e-4197-9c56-b4e8b871544a None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:07.499282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f253dce2-642e-4197-9c56-b4e8b871544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:07.508558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 764/1526] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Aug 31 00:17:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:07.516474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379f96e-91ec-4aed-bc9b-8f85aa3171a1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:07.530451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379f96e-91ec-4aed-bc9b-8f85aa3171a1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:07.535483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24def230-87ff-4599-b00b-4398043ecc51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:07.536063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24def230-87ff-4599-b00b-4398043ecc51 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.536340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24def230-87ff-4599-b00b-4398043ecc51 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.536612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24def230-87ff-4599-b00b-4398043ecc51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.544832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24def230-87ff-4599-b00b-4398043ecc51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:07.546463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24def230-87ff-4599-b00b-4398043ecc51 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:07.556222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 763/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:11.259603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b402-420a-49f9-bc77-cb024a78174f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.260144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b402-420a-49f9-bc77-cb024a78174f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.260144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b402-420a-49f9-bc77-cb024a78174f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.261524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:11.266833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320ff18-f39c-4829-9ec1-bb247911400c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.267227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320ff18-f39c-4829-9ec1-bb247911400c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.267378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320ff18-f39c-4829-9ec1-bb247911400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.286447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c320ff18-f39c-4829-9ec1-bb247911400c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:11.287621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c320ff18-f39c-4829-9ec1-bb247911400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.297829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:11.583487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b402-420a-49f9-bc77-cb024a78174f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:11.585197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-02b6b402-420a-49f9-bc77-cb024a78174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.661924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b402-420a-49f9-bc77-cb024a78174f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:11.665471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b88c8a-6087-4f97-8fe7-93c93eb9d07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:11.666096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88c8a-6087-4f97-8fe7-93c93eb9d07c service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.666377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88c8a-6087-4f97-8fe7-93c93eb9d07c service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.666648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88c8a-6087-4f97-8fe7-93c93eb9d07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.676329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b88c8a-6087-4f97-8fe7-93c93eb9d07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:11.677759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b88c8a-6087-4f97-8fe7-93c93eb9d07c service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:11.688681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 766/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:13.596443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58682ab-8220-4346-a9f7-fa3effb54171 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.597026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58682ab-8220-4346-a9f7-fa3effb54171 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.597026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58682ab-8220-4346-a9f7-fa3effb54171 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.598429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:13.603540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d691-1809-4e4c-9962-6332bb6e54c5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.603979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d691-1809-4e4c-9962-6332bb6e54c5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.604085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d691-1809-4e4c-9962-6332bb6e54c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.623650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9f59d691-1809-4e4c-9962-6332bb6e54c5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:13.624830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9f59d691-1809-4e4c-9962-6332bb6e54c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:13.632549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:13.916553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58682ab-8220-4346-a9f7-fa3effb54171 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.918813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e58682ab-8220-4346-a9f7-fa3effb54171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:13.931840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58682ab-8220-4346-a9f7-fa3effb54171 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.935357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192bc4b-dad4-481e-ad8b-fd48a985c339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.935943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192bc4b-dad4-481e-ad8b-fd48a985c339 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.936216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192bc4b-dad4-481e-ad8b-fd48a985c339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.936485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192bc4b-dad4-481e-ad8b-fd48a985c339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.945052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192bc4b-dad4-481e-ad8b-fd48a985c339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.946494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192bc4b-dad4-481e-ad8b-fd48a985c339 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.955623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 766/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:17:17.590814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77cef0-ef08-47a0-a627-78983f728dc6 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:17.591353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77cef0-ef08-47a0-a627-78983f728dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:17.591353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77cef0-ef08-47a0-a627-78983f728dc6 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:17.592705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:17.597803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97051b-6571-40b5-9698-dbd53e652025 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:17.598221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97051b-6571-40b5-9698-dbd53e652025 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:17.598394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97051b-6571-40b5-9698-dbd53e652025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:17.618309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ba97051b-6571-40b5-9698-dbd53e652025 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:17.619509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ba97051b-6571-40b5-9698-dbd53e652025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:17.627279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:18.173816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77cef0-ef08-47a0-a627-78983f728dc6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:18.175738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dc77cef0-ef08-47a0-a627-78983f728dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:18.247515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:18.260613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77cef0-ef08-47a0-a627-78983f728dc6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:18.264202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da553a66-fc58-4c71-a1fa-e8de1d3eded1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:18.264804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da553a66-fc58-4c71-a1fa-e8de1d3eded1 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:18.265082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da553a66-fc58-4c71-a1fa-e8de1d3eded1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:18.265355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da553a66-fc58-4c71-a1fa-e8de1d3eded1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:18.274605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da553a66-fc58-4c71-a1fa-e8de1d3eded1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:18.276541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da553a66-fc58-4c71-a1fa-e8de1d3eded1 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:18.285828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 769/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:20.226040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd75e-245a-45ec-a447-7fe32c18aac4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:20.226606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd75e-245a-45ec-a447-7fe32c18aac4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:20.226606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd75e-245a-45ec-a447-7fe32c18aac4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:20.227847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:20.233513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf6fed-3e84-46e6-b31e-710f4b539e51 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:20.233974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf6fed-3e84-46e6-b31e-710f4b539e51 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:20.234097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf6fed-3e84-46e6-b31e-710f4b539e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:20.254077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6ddf6fed-3e84-46e6-b31e-710f4b539e51 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:20.255270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6ddf6fed-3e84-46e6-b31e-710f4b539e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:20.263061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:20.810397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dd75e-245a-45ec-a447-7fe32c18aac4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:20.812059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a6dd75e-245a-45ec-a447-7fe32c18aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:20.825485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dd75e-245a-45ec-a447-7fe32c18aac4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:20.829011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852990b-e3ac-4ddd-a0f1-2ee47fa59cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:20.829608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852990b-e3ac-4ddd-a0f1-2ee47fa59cfb service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:20.829915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852990b-e3ac-4ddd-a0f1-2ee47fa59cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:20.830189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852990b-e3ac-4ddd-a0f1-2ee47fa59cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:20.840138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852990b-e3ac-4ddd-a0f1-2ee47fa59cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:20.841561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852990b-e3ac-4ddd-a0f1-2ee47fa59cfb service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:20.850937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 769/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:30.249165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=11 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:30.846770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=33 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:44.486099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.487169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.487681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.510830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:44.512992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:44.525983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 771/1540] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:44.531381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.531898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.531995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.563443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:44.564856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:44.577448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 770/1541] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:44.582346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:44.599812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83901485-09b5-4e88-9c9f-464d4c9fd3c9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:44.605260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:44.606268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.606862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.607346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.608229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:44.608759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:44.610638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:44.629445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 772/1542] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:44.638028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:44.652768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cdc4-b729-46e2-b8b5-ba7f61a3fd9d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:44.662015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84ed3-9474-4cda-86ae-ddb3e9520a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:44.662649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84ed3-9474-4cda-86ae-ddb3e9520a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.662923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84ed3-9474-4cda-86ae-ddb3e9520a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.663288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84ed3-9474-4cda-86ae-ddb3e9520a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.663945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b84ed3-9474-4cda-86ae-ddb3e9520a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:44.666004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b84ed3-9474-4cda-86ae-ddb3e9520a4c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:44.722622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 771/1543] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:44.727204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:44.734952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a44f-6b33-465c-a31b-17952b712016 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.735293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a44f-6b33-465c-a31b-17952b712016 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.735506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a44f-6b33-465c-a31b-17952b712016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.742770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e35e9b-ca3f-47ad-ab7d-70010edc6d9d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:44.787589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c555a44f-6b33-465c-a31b-17952b712016 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:44.788788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c555a44f-6b33-465c-a31b-17952b712016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:44.883486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac872a-c319-4c65-9bae-ee6519a66ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:44.884434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac872a-c319-4c65-9bae-ee6519a66ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.884919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac872a-c319-4c65-9bae-ee6519a66ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.885379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac872a-c319-4c65-9bae-ee6519a66ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.886217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac872a-c319-4c65-9bae-ee6519a66ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:44.888348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac872a-c319-4c65-9bae-ee6519a66ad1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:44.908481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 772/1544] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:44.908481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.908481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.908481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.937944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 773/1545] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:44.939585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3fd5f-8d16-4049-9474-cc9b5b57ec88 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.940148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3fd5f-8d16-4049-9474-cc9b5b57ec88 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.942911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3fd5f-8d16-4049-9474-cc9b5b57ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.947944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:44.947944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:44.963444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 773/1546] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:44.964112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:44.974588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a8a3fd5f-8d16-4049-9474-cc9b5b57ec88 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:44.975881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a8a3fd5f-8d16-4049-9474-cc9b5b57ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:44.981406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d04ae-23ee-4d84-8941-3d42c0495e8c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:44.986431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd351f-6c01-4a27-8167-41280b1363c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:44.987232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd351f-6c01-4a27-8167-41280b1363c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.987679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd351f-6c01-4a27-8167-41280b1363c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.988120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd351f-6c01-4a27-8167-41280b1363c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:44.989212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd351f-6c01-4a27-8167-41280b1363c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:44.991124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd351f-6c01-4a27-8167-41280b1363c0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:44.998128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 774/1547] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:44.999215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:44.999501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:44.999773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.003789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 774/1548] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:45.005324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186d2b7-1110-4dd1-a3a2-71175bb8d46f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.005781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186d2b7-1110-4dd1-a3a2-71175bb8d46f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.006370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186d2b7-1110-4dd1-a3a2-71175bb8d46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.028148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f186d2b7-1110-4dd1-a3a2-71175bb8d46f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.029984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f186d2b7-1110-4dd1-a3a2-71175bb8d46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.039390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 775/1549] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.041073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.041564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.042094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.044186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.045460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.064486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 775/1550] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.066374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.073772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.074933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.083032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 776/1551] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.083849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.086774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e51c-e336-457e-9e17-090060f142a0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.092292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.092909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.093191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.093464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.093958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42107a9f-fa8e-49cc-86fb-52d8e22aad1a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.094165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.094450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.096051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7474d-b538-4a67-8d14-9fde73859f99 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.098848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c956b-7b18-4011-943c-c18d0d338a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.099442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c956b-7b18-4011-943c-c18d0d338a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.099718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c956b-7b18-4011-943c-c18d0d338a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.099988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c956b-7b18-4011-943c-c18d0d338a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.100617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c956b-7b18-4011-943c-c18d0d338a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.102776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c956b-7b18-4011-943c-c18d0d338a57 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.108931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 776/1552] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.110148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85be0e2-51dc-426c-a2c4-5f53b97fd41d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.110433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85be0e2-51dc-426c-a2c4-5f53b97fd41d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.110705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85be0e2-51dc-426c-a2c4-5f53b97fd41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.116151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 777/1553] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:45.116151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194ca9e-60d3-4383-a2bc-dfdb12d90d79 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.116151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194ca9e-60d3-4383-a2bc-dfdb12d90d79 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.116151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194ca9e-60d3-4383-a2bc-dfdb12d90d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.132915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f85be0e2-51dc-426c-a2c4-5f53b97fd41d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.134145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f85be0e2-51dc-426c-a2c4-5f53b97fd41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.134772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f194ca9e-60d3-4383-a2bc-dfdb12d90d79 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.135947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f194ca9e-60d3-4383-a2bc-dfdb12d90d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.143908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.144838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.145118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.145390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.156753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.158004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fcaa-bbf3-47e2-97df-2d9ff115b4a7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.158289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fcaa-bbf3-47e2-97df-2d9ff115b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.158560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2fcaa-bbf3-47e2-97df-2d9ff115b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.165118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.166338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.174413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.175011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.179393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-72d2fcaa-bbf3-47e2-97df-2d9ff115b4a7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.180558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-72d2fcaa-bbf3-47e2-97df-2d9ff115b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.184004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b600741-df50-4070-b879-9f3c910dc8f6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.188441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.188561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.189134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.189412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.189615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.189725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.189938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.190162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.190342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.190645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.191647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:18:45.191647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:18:45.191647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:18:45.192596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.205948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.206642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.215605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.216975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.218074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55a0c7-1045-490c-8d2e-fa1dfe807085 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.222601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36855-f59c-4ad6-95b2-914c3f17ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.223231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36855-f59c-4ad6-95b2-914c3f17ed0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.223512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36855-f59c-4ad6-95b2-914c3f17ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.223785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36855-f59c-4ad6-95b2-914c3f17ed0b admin admin] PATH_INFO: `/v3/projects/7dadd80d2dde4b8db7db81f804c0a35f/users/b245080543f84be9880518049e59809f/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.225403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.226583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.237594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d495e4-68f9-45af-8297-a579d1f2c7c5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.242704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.243308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.243588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.243699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36855-f59c-4ad6-95b2-914c3f17ed0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dadd80d2dde4b8db7db81f804c0a35f, user_id=b245080543f84be9880518049e59809f, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.243861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.244494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.245509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:18:45.245509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:18:45.245509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:18:45.246395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36855-f59c-4ad6-95b2-914c3f17ed0b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.246762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.259196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 781/1560] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:45 2022] PUT /identity/v3/projects/7dadd80d2dde4b8db7db81f804c0a35f/users/b245080543f84be9880518049e59809f/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:45.260410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.260699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.260964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.280876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 780/1561] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.281705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.287286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.289109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.315008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:45.344137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7714e-be46-4523-9e5d-030fb5cfcc83 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.348726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.349043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 782/1562] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.350054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.352929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.353226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.353534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.354233 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.354716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.356331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bad2-8007-4ca1-ac3a-7e9df5fd045b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.358815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:45.359258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7615-8ee2-46c1-9a5e-64e6997ae823 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.364427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.365154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.365445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.365743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.367401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.367852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.369463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.370071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.371280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6bb4-b6b2-4fd9-92a0-828f030ab831 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.371562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6bb4-b6b2-4fd9-92a0-828f030ab831 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.371830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6bb4-b6b2-4fd9-92a0-828f030ab831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.389055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 783/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.389884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.392626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-619c6bb4-b6b2-4fd9-92a0-828f030ab831 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.393830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-619c6bb4-b6b2-4fd9-92a0-828f030ab831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.399436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72e99d-5604-4ea0-b534-9003708f8d72 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.403811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 782/1565] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.403976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.404505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.404783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.405053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.405355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6975-f66e-4b8e-8a46-a23b327ff97e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.405676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.405861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6975-f66e-4b8e-8a46-a23b327ff97e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.406259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6975-f66e-4b8e-8a46-a23b327ff97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.407861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.425558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3b4a6975-f66e-4b8e-8a46-a23b327ff97e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.426765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3b4a6975-f66e-4b8e-8a46-a23b327ff97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.435211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 783/1566] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.436310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 784/1567] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.437261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.440170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.440471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.440754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.467825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] MFA Rules not processed for user `b245080543f84be9880518049e59809f`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:45.469021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:45.498992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a612d-7137-45dd-b085-5af7926e7b64 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.503555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.504151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.504430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.504702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.505331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.506656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:18:45.506656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:18:45.506656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:18:45.507596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.529891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 785/1568] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.531195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.536166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 784/1569] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:45.536962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.545230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3d1a4-0111-4cd4-9343-69c89fdfe8ad admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.547442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ced4a-04ff-4b3d-af8c-fc4105d97aeb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.550413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.551040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.551323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.551599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.552244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.552360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.552551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.553017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.553358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.553685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.554385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.554513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.556434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.567686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 786/1570] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.568490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.580828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63137-676c-43aa-8fc0-2a3fb63d0237 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.585514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.586126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.586344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 785/1571] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.586476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.586705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.587206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.587326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.589144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.619263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 787/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.619263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.650808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22f9c-24c6-440a-8671-1913dbcb0c47 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.667844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:45.681086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e26aec-2cc7-4bc6-820b-c58f4c5aac30 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.685768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.686399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.686674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.686958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.687569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.689494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.702252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:45.709485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.710132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.710607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.710952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.711615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.712068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 788/1573] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.712184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.712748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.713782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.722199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c96366-07bd-416f-b55c-923545974fc4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.731462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 786/1574] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.731462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.733028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.733631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.733937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.734212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.734852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:45.735153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.736472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6eeeb-54af-49ff-80c3-c0d7ce9cb869 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.736749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.741637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.742255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.742534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.742808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.743440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.745023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.749325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 789/1575] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:45.751164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.758970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 787/1576] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:45.758970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.762329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b977e-f4aa-45de-b351-7fbb453902b1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.766935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.767523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.767832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.768131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.768795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.768904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954295-3fed-4be1-b72b-59076346f4d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.770767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.773454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.774064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.774344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.774613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.775227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.777093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.801743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 790/1577] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.801743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.808269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 788/1578] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.809106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.861998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c803bc4-19b4-47b9-a551-135db0dad12b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.877621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842e706-7966-493d-8bbc-af99968c1fb0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.882524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.883131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.883555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.883831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.884455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.886413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.912399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 789/1579] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.912399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.922126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.922734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.923014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.923185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db171721-149b-4eb8-871e-2286953b750a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.923331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.923900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.926106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.928252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.929368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.929646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.929960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.930629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.932239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.947406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 790/1580] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:45.947406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.951712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 791/1581] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.951712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.955072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42a2f-3eaf-4fed-b265-ece8160fdc41 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.959685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.960084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937d5b-0b2a-47e9-86e6-929202d124f1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:45.960289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.960565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.960837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.961450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.963370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.964670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:45.965244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:45.965528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:45.965907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:45.966529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:45.968421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:45.990463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 791/1582] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.991778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:45.997877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 792/1583] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:45.998772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.020323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.059869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee276-7167-4b6a-8b3b-a1556d755212 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.063319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fab00-2d72-442a-8b23-113095a602d5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.064458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.065048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.065324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.065599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.066258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.067845 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.067988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.068556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.068964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.069110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.070634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.072253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.078155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 792/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.082256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.093105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67812ff6-3ce2-4e5f-9d94-d88be3d9e0ee admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.093507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 793/1585] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:45 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:46.094338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.100718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.101324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.101604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.101908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.102534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.103588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9dd94-79be-4867-b098-69ce66acad25 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.104458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.108430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.109013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.109293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.109565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.110299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.111922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.114460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.122651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 794/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.123537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.126948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 793/1587] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:46.128155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.134960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7dc78-86fe-4039-ab17-d9af6f0dd6de admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.138195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d46f3-81e1-4202-8c24-246ebdd0701c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.139890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.140524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.140808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.141085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.141758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.143130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.143393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.143716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.144012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.144263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.144896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.146508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.161359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 795/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.161359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.161635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 794/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.161635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.166805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb97d-bb50-47fe-9aeb-71b22d7e4fdf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.168270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ba338-c258-4313-a092-0620bd356c09 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.171368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.171951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.172232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.172506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.172974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.173109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.173546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.173821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.174377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.174985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.175315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.176896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.199894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 796/1590] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/users => generated 303 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:46.199894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.200205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 795/1591] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/users => generated 296 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:46.200205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.208869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e85f8f-6b23-436f-9b8c-21788b4de2c2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.209940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f311-a004-43db-88ed-619b2451fafe admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.214093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.214746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.214874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.215075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.215295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] PATH_INFO: `/v3/projects/eed416bd0f5f4e2e8453db6ff35f6ac5/users/a76438b57a2140cca853e0e71fb28f64/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.215400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.215673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.215946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.216564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.219164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.229137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 796/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.229887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.231446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed416bd0f5f4e2e8453db6ff35f6ac5, user_id=a76438b57a2140cca853e0e71fb28f64, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.234188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.239637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217f170-1683-42d7-8224-88d03ee530bf admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.244740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.245352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.245625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.245923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.246556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.248108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.248496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 797/1593] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/eed416bd0f5f4e2e8453db6ff35f6ac5/users/a76438b57a2140cca853e0e71fb28f64/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.249290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.265573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 797/1594] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.265573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.273447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d9e79-2f3d-41aa-982f-963141db5299 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.311203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6188e-2d3e-46f4-a33e-eb1ab2dbf2a6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.315898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.316548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.316826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.317109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.317728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.320183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.329640 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.330104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 798/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.330316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.330541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.330811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.331440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.333261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.333764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.343789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56fa1-5664-4a56-853b-f65e8ce1e9cd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.344340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 798/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.345133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.351557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.352286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.352570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.352748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] PATH_INFO: `/v3/projects/6964278bedc24b9eaae22c6404f97641/users/f6770bc9decf4cdab930ed176633e3ed/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.354515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e4208-34b0-4c34-8791-01b0544abcc9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.358960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.359534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.359808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.360077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.360696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.362301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.367424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6964278bedc24b9eaae22c6404f97641, user_id=f6770bc9decf4cdab930ed176633e3ed, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.370059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.372042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 799/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.372884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.383489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082cfe-a46c-4e7c-a84e-8229aed138b3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.384669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 799/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/6964278bedc24b9eaae22c6404f97641/users/f6770bc9decf4cdab930ed176633e3ed/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.395547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.405024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.442026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb122a-9b39-423e-8732-93a41689a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.442847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb122a-9b39-423e-8732-93a41689a3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.443145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb122a-9b39-423e-8732-93a41689a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.443485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb122a-9b39-423e-8732-93a41689a3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.444203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb122a-9b39-423e-8732-93a41689a3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.446358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb122a-9b39-423e-8732-93a41689a3a6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.454725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f1b0-5bda-47d3-9a80-dd5723b32ef4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.458793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 800/1599] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.459626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.460974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.461321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.461662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] PATH_INFO: `/v3/projects/88e6f9c44eca4ea6affc9ebedbed9bca/users/ce027e59939f44d5b2dfbae293a7aa1e/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.463537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.463828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.464110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.478081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e6f9c44eca4ea6affc9ebedbed9bca, user_id=ce027e59939f44d5b2dfbae293a7aa1e, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.480771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.482439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:46.483625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:46.491869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 801/1600] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:46.492608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.494367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 800/1601] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/88e6f9c44eca4ea6affc9ebedbed9bca/users/ce027e59939f44d5b2dfbae293a7aa1e/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.497740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.502249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218401-8931-42eb-8bd7-dedbefe248de None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.515306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.558474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebddfc6-91ad-4396-8b5b-a51aeee87869 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.560735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.561393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.561664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.561960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] PATH_INFO: `/v3/projects/258e6d65abf74a58af993ca946d98798/users/ced4ad031f324edb89eff6133fbf9543/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.563315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.563938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.564214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.564482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.565142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.566808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.576326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258e6d65abf74a58af993ca946d98798, user_id=ced4ad031f324edb89eff6133fbf9543, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.577360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:18:46.577360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:18:46.577360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:18:46.577628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 801/1602] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.578933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.579334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.588941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eea4e-82ff-4590-a126-7f3235bc8658 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.592451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 802/1603] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/258e6d65abf74a58af993ca946d98798/users/ced4ad031f324edb89eff6133fbf9543/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.594932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.645479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.646059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.646335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.646602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] PATH_INFO: `/v3/projects/05c1629acc2f4111a11c63e91cf8f289/users/a0b77901f5cd47cf8469a4519be08a46/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.657567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97de1-fec2-4c51-89ea-b45d0c95d9c7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.661267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c1629acc2f4111a11c63e91cf8f289, user_id=a0b77901f5cd47cf8469a4519be08a46, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.662105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96be3-1d59-4928-b812-9fad4a378757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.662730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96be3-1d59-4928-b812-9fad4a378757 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.663002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96be3-1d59-4928-b812-9fad4a378757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.663830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96be3-1d59-4928-b812-9fad4a378757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.664458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96be3-1d59-4928-b812-9fad4a378757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.664559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.666055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96be3-1d59-4928-b812-9fad4a378757 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.676773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 803/1604] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.678207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.678492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.678797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.681924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 802/1605] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/05c1629acc2f4111a11c63e91cf8f289/users/a0b77901f5cd47cf8469a4519be08a46/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.682581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.703445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.712788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] MFA Rules not processed for user `f6770bc9decf4cdab930ed176633e3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:46.714039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:46.746788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d576ea-da81-408f-922d-b5ed34b408ea admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.751887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.752588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.752865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.753133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.753771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.755413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.765803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 803/1606] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.766614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.775832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d370c-d23d-4c17-9337-15e6b19e85de admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.779015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 804/1607] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:46.779837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.782972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.783655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.783942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.784217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.784857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.786512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.796647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 804/1608] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:46.797565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.807604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c7e09-6e30-4acc-9d2b-9f90c1f028e4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.809111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:46.812364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54c70-4279-4ce6-a7c4-ea5b5e3cbdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.812982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54c70-4279-4ce6-a7c4-ea5b5e3cbdef admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.813259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54c70-4279-4ce6-a7c4-ea5b5e3cbdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.813531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54c70-4279-4ce6-a7c4-ea5b5e3cbdef admin admin] PATH_INFO: `/v3/projects/74bc2aed79de4b3d92d19ef9bf26cc51/users/3f519b1d9a1149169b8142e738320a89/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.828906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c54c70-4279-4ce6-a7c4-ea5b5e3cbdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bc2aed79de4b3d92d19ef9bf26cc51, user_id=3f519b1d9a1149169b8142e738320a89, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.831637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c54c70-4279-4ce6-a7c4-ea5b5e3cbdef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.836088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4729d7-ae6d-42bd-b6b5-486547298ba6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.840104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.840707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.840981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.841249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.845024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 805/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/74bc2aed79de4b3d92d19ef9bf26cc51/users/3f519b1d9a1149169b8142e738320a89/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.846644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d7930-9dd6-4e3f-a3b5-5e5d90166170 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.847392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d7930-9dd6-4e3f-a3b5-5e5d90166170 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.847845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d7930-9dd6-4e3f-a3b5-5e5d90166170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.850576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.852517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.861943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 805/1610] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:46.862738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.871985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1dd6-d751-459d-a227-88516dd4c16c service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:46.877888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c92d7930-9dd6-4e3f-a3b5-5e5d90166170 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:46.879038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c92d7930-9dd6-4e3f-a3b5-5e5d90166170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:46.933355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:46.934047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.934325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.934628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] PATH_INFO: `/v3/projects/db63eceb5e424414949d2f32d89971ec/users/c36c94053c2848d3a149e495a7ec9054/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.942670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 806/1611] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:46.944003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:46.944292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:46.944594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:46.959072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db63eceb5e424414949d2f32d89971ec, user_id=c36c94053c2848d3a149e495a7ec9054, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:46.962940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:46.979681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 806/1612] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/db63eceb5e424414949d2f32d89971ec/users/c36c94053c2848d3a149e495a7ec9054/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:46.981393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] MFA Rules not processed for user `a0b77901f5cd47cf8469a4519be08a46`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:46.982736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:46.983613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.052006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4470-5504-457e-9ba3-a80385c7d8b8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.057014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.057696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.058017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.058290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] PATH_INFO: `/v3/projects/0043c999ad9d451ab45c19cbea1765ea/users/c924dfe7e9c941f9b7110c1a440633dc/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.059465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 807/1613] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:47.060337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.072895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d56ff5-830c-47b8-b700-8405488dd518 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.078068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110995d-9a94-464e-bc2f-46584eff2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.078678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110995d-9a94-464e-bc2f-46584eff2f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.078959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110995d-9a94-464e-bc2f-46584eff2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.079232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110995d-9a94-464e-bc2f-46584eff2f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.079924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110995d-9a94-464e-bc2f-46584eff2f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.081542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0043c999ad9d451ab45c19cbea1765ea, user_id=c924dfe7e9c941f9b7110c1a440633dc, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.081931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110995d-9a94-464e-bc2f-46584eff2f3a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.085634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.098510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:47.102808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 807/1614] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:46 2022] PUT /identity/v3/projects/0043c999ad9d451ab45c19cbea1765ea/users/c924dfe7e9c941f9b7110c1a440633dc/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:47.103576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.126230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 808/1615] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:47.126230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.126230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.126230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.149177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:47.150392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.151961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:47.179121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ee1aa-3ceb-4a78-a922-b911a15807ce admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.222867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 809/1616] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:47.223783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.249439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a554ab9-091d-46bb-ad3f-7754855901f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.250665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a554ab9-091d-46bb-ad3f-7754855901f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.251047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a554ab9-091d-46bb-ad3f-7754855901f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.251321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a554ab9-091d-46bb-ad3f-7754855901f0 admin admin] PATH_INFO: `/v3/projects/88e6f9c44eca4ea6affc9ebedbed9bca/users/ce027e59939f44d5b2dfbae293a7aa1e/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.255161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a554ab9-091d-46bb-ad3f-7754855901f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e6f9c44eca4ea6affc9ebedbed9bca, user_id=ce027e59939f44d5b2dfbae293a7aa1e, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.259997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a554ab9-091d-46bb-ad3f-7754855901f0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.272014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 808/1617] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:47 2022] PUT /identity/v3/projects/88e6f9c44eca4ea6affc9ebedbed9bca/users/ce027e59939f44d5b2dfbae293a7aa1e/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:47.274357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.274873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.275485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.300657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:47.301945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.302277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201011ec-4087-4e3b-b5cf-15b354003e10 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.363044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.364165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.364165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.364165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.377031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 809/1618] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:47.377692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.388242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f626fb-92f2-4faa-8adb-a5bea46d72de None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.393633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d0c29-667e-4b99-9370-9cd83bffcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.394452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d0c29-667e-4b99-9370-9cd83bffcb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.394785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d0c29-667e-4b99-9370-9cd83bffcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.395498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d0c29-667e-4b99-9370-9cd83bffcb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.396145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d0c29-667e-4b99-9370-9cd83bffcb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.398673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d0c29-667e-4b99-9370-9cd83bffcb45 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.430378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 810/1619] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:47.431555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.431834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.432104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.451679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:47.452920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.453075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:47.456263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.458941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.470995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 810/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:47.472155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.482201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d31e22-bd19-4f45-869a-657e28616152 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.511566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:47.527467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 811/1621] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:47.528246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.553526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43603b93-921b-4ed9-8035-73171b89fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.554206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43603b93-921b-4ed9-8035-73171b89fc03 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.554488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43603b93-921b-4ed9-8035-73171b89fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.555168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43603b93-921b-4ed9-8035-73171b89fc03 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.555427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43603b93-921b-4ed9-8035-73171b89fc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.557357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43603b93-921b-4ed9-8035-73171b89fc03 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.579662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 811/1622] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:47.580900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.581498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.581498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.593423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1702-c493-4069-8750-3fa14235ded9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.598663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.600012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.600306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.600621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.610650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] MFA Rules not processed for user `ce027e59939f44d5b2dfbae293a7aa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:47.611962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.614289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.616324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.631293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 812/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:47.633347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.643693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d5a9-117c-4e7c-8235-cb961fe93af1 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.648126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.648707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.648987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.650146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.659314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.661224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.682112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 813/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:47.685137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.698051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 812/1625] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:47.703949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.704088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378461d6-70c2-4936-ba29-49e6e976d344 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.713135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.714403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.714694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.714973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.715914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.718055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23c965-d109-4167-801c-aa1cc4c3651c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.718378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.728113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.730696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.730913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.731238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.751098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.752810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.763766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 814/1626] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/users => generated 292 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:47.764837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.766214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 813/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:47.767086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.779856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a91d9-12ce-4f12-b400-269e9f27d3cd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.787379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.788750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.789276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.789883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.790807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.794342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.810695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 815/1628] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:47.815897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.829938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bc611-e081-4fe2-86c5-3d62339d35e8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.837833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.838173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.838557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.839125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.840110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.842107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.854486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba206ed-9f75-4182-a99b-e24c0c456bb8 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.861126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 816/1629] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:47.861314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.861430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.861520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.861520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.861520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.872801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d525-5329-4f55-a3d4-1ad81f65dd1a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.875754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.877079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.881029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.882924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.883268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.884004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] PATH_INFO: `/v3/projects/4bd991eecbc5444f82fb7b091c4e9da6/users/c51f5869278a4900b97e72c4f2325c5b/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.884948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:47.908587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 814/1630] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:47.909939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd991eecbc5444f82fb7b091c4e9da6, user_id=c51f5869278a4900b97e72c4f2325c5b, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.911273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.914099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.934328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 817/1631] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:47 2022] PUT /identity/v3/projects/4bd991eecbc5444f82fb7b091c4e9da6/users/c51f5869278a4900b97e72c4f2325c5b/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:47.938289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6982-baa2-4ae7-9754-6fefa75fc3dc service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.940044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.032379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.033536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.034202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.034752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] PATH_INFO: `/v3/projects/74a9e939ff584ddf9eee5eb9ffb44494/users/852719d6589d4c819ed472a62bed2be2/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.053592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a9e939ff584ddf9eee5eb9ffb44494, user_id=852719d6589d4c819ed472a62bed2be2, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.057077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.076436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355ca8-74a5-4f38-9e90-e26643a4db4c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.079618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 815/1632] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:47 2022] PUT /identity/v3/projects/74a9e939ff584ddf9eee5eb9ffb44494/users/852719d6589d4c819ed472a62bed2be2/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:48.081360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.108813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:48.161468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f22d-9b7e-4dc3-91ec-831460fdaf78 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.171261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.172065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.172342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.174733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.186351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.189423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.189759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.191117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.192054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.196466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.227399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 818/1633] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:48.228353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.252396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb8b6f-799e-4bef-ab00-3f6f81b3475d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.264869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.265498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.267239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.267239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.269653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.276489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.305535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 819/1634] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:48.310228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.327876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.333369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.334080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc668-3944-46b7-acb4-90ba1c4da06f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.346142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d79b-385b-4225-9665-9633bffecba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.346502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d79b-385b-4225-9665-9633bffecba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.347948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d79b-385b-4225-9665-9633bffecba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.348394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d79b-385b-4225-9665-9633bffecba2 admin admin] PATH_INFO: `/v3/projects/4bd991eecbc5444f82fb7b091c4e9da6/users/c51f5869278a4900b97e72c4f2325c5b/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.353762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3d79b-385b-4225-9665-9633bffecba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd991eecbc5444f82fb7b091c4e9da6, user_id=c51f5869278a4900b97e72c4f2325c5b, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.367348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 816/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:48.371064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.373383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3d79b-385b-4225-9665-9633bffecba2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.406490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65767d5-d6e3-4e18-8377-6c6887e78d06 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.429658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 820/1636] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:48 2022] PUT /identity/v3/projects/4bd991eecbc5444f82fb7b091c4e9da6/users/c51f5869278a4900b97e72c4f2325c5b/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:48.434963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.434963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.434963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.535474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] MFA Rules not processed for user `c51f5869278a4900b97e72c4f2325c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:48.539722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:48.566175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:48.636404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d72c06-22df-4d45-b505-a12063299b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.637289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d72c06-22df-4d45-b505-a12063299b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.638981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d72c06-22df-4d45-b505-a12063299b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.639277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d72c06-22df-4d45-b505-a12063299b2e admin admin] PATH_INFO: `/v3/projects/74a9e939ff584ddf9eee5eb9ffb44494/users/852719d6589d4c819ed472a62bed2be2/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.647319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d72c06-22df-4d45-b505-a12063299b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a9e939ff584ddf9eee5eb9ffb44494, user_id=852719d6589d4c819ed472a62bed2be2, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.654516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d72c06-22df-4d45-b505-a12063299b2e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.687470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 817/1637] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:48 2022] PUT /identity/v3/projects/74a9e939ff584ddf9eee5eb9ffb44494/users/852719d6589d4c819ed472a62bed2be2/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:48.697178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f028-fe63-4f39-af21-6f69cef5941d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.697482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f028-fe63-4f39-af21-6f69cef5941d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.698244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f028-fe63-4f39-af21-6f69cef5941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.758881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 821/1638] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:48.766773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.776489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-07b0f028-fe63-4f39-af21-6f69cef5941d None None] MFA Rules not processed for user `852719d6589d4c819ed472a62bed2be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:48.780631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-07b0f028-fe63-4f39-af21-6f69cef5941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:48.912868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c8042-ca82-4a7e-8835-48e1c9f44948 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.967709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 818/1639] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:48.969142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.969425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.971658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.021763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:49.047683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.049829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.050219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.050877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] MFA Rules not processed for user `c36c94053c2848d3a149e495a7ec9054`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:49.050998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.054202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:49.189928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.191409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.210397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 819/1640] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:49.211403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.220685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 822/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:49.222835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.300018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5568b59-f261-4dba-8925-94762f7da82a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:49.300018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.300018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.300018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.306664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.320024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.322402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.340794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 820/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:49.406715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d339c-d64c-4ccb-bc22-63dde4fc1f8f service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:49.412588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.414103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.414942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.415427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.416280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.418626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.462208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.472354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f966e8-382b-47af-b69e-69bc08f833bf service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:49.480309 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.481205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.481685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.482368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 823/1643] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:49 2022] POST /identity/v3/projects => generated 405 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:49.482490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.487568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.559484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:49.640871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.646130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.651196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d50c9-2b17-4191-9346-67f68f469782 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:49.660151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.661051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.661722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.662177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.663327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.668286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.670201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 821/1644] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:49.701697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 824/1645] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:49 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:49.704044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.722946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da94c-24c1-46a4-bc6c-50558158ff80 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:49.730653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.731389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.731769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.732136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.733357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.741207 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.766380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 822/1646] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:49.767858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.786456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f84e5-540a-4c3f-be88-3c1e686c786d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:49.803276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:49.804254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:49.804678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:49.805135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] PATH_INFO: `/v3/projects/f1b21b0fc83046bba171c458e6c347c9/users/2009aaaff1864bf786aa44c097758e88/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:49.810948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:49.851930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b21b0fc83046bba171c458e6c347c9, user_id=2009aaaff1864bf786aa44c097758e88, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:49.864341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:49.903333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 825/1647] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:49 2022] PUT /identity/v3/projects/f1b21b0fc83046bba171c458e6c347c9/users/2009aaaff1864bf786aa44c097758e88/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:49.907512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:49.925364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d584b1-4be3-4a1d-95d9-0b61a66b10aa admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:50.111230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:50.112182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:50.114675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:50.115111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:50.115865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:50.128529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:50.144561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 823/1648] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:50.149120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:50.169279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05e96e-3b34-4bfe-b24e-0f0e36474ea3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:50.185423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c904ee0-8b69-4b7c-a883-fa5d2e3b8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:50.186269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c904ee0-8b69-4b7c-a883-fa5d2e3b8af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:50.186551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c904ee0-8b69-4b7c-a883-fa5d2e3b8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:50.186825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c904ee0-8b69-4b7c-a883-fa5d2e3b8af5 admin admin] PATH_INFO: `/v3/projects/f1b21b0fc83046bba171c458e6c347c9/users/2009aaaff1864bf786aa44c097758e88/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:50.193301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c904ee0-8b69-4b7c-a883-fa5d2e3b8af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b21b0fc83046bba171c458e6c347c9, user_id=2009aaaff1864bf786aa44c097758e88, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:50.206447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c904ee0-8b69-4b7c-a883-fa5d2e3b8af5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:50.237909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 826/1649] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:50 2022] PUT /identity/v3/projects/f1b21b0fc83046bba171c458e6c347c9/users/2009aaaff1864bf786aa44c097758e88/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:50.351790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:50.369019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057d49b-55b0-4e57-90b1-a1bd84ccfe76 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:50.498913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:50.499566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:50.499838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:50.500156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] PATH_INFO: `/v3/users/a0b77901f5cd47cf8469a4519be08a46` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:50.501311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b77901f5cd47cf8469a4519be08a46)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:50.503267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:50.627006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b77901f5cd47cf8469a4519be08a46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:50.627789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b77901f5cd47cf8469a4519be08a46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:50.628435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b77901f5cd47cf8469a4519be08a46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:50.645184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:50.657637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b77901f5cd47cf8469a4519be08a46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:50.676574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b77901f5cd47cf8469a4519be08a46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:50.714054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 824/1650] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:18:50 2022] DELETE /identity/v3/users/a0b77901f5cd47cf8469a4519be08a46 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:50.716524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:50.716877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:50.717153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:50.765165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:50.766616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:50.932402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 827/1651] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:51.014473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:51.015983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:51.134034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d12d29-5f12-4c16-8191-d048b16a7af8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:51.145827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:51.150344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:51.152357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:51.152695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:51.191075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:51.192738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:51.228430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 825/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:53.239670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:53.241770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:53.266080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922cd94-02eb-4a42-94aa-20793c1bf5d3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:53.275790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:53.276445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:53.276726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:53.277077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] PATH_INFO: `/v3/projects/05c1629acc2f4111a11c63e91cf8f289` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:53.279958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c1629acc2f4111a11c63e91cf8f289)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:53.283244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:53.418823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c1629acc2f4111a11c63e91cf8f289', 'request_id': 'req-7822399a-bb59-4c44-8f59-8cdb2b26cb03'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.445278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c1629acc2f4111a11c63e91cf8f289', 'request_id': 'req-7822399a-bb59-4c44-8f59-8cdb2b26cb03'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.474991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c1629acc2f4111a11c63e91cf8f289', 'request_id': 'req-7822399a-bb59-4c44-8f59-8cdb2b26cb03'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.503157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] The token cache is being invalidate because project 05c1629acc2f4111a11c63e91cf8f289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:18:53.503476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.504558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.515059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 828/1653] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:18:53 2022] DELETE /identity/v3/projects/05c1629acc2f4111a11c63e91cf8f289 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:53.518960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:53.526058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:53.532265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:53.535772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908460e-11ed-4510-b285-366bb5d58a93 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:53.763453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:53.778620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:53.779391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:53.779831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:53.781583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] PATH_INFO: `/v3/users/852719d6589d4c819ed472a62bed2be2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:53.785012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852719d6589d4c819ed472a62bed2be2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:53.790006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:53.813217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822399a-bb59-4c44-8f59-8cdb2b26cb03 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:53.830509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:53.831068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:53.831395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:53.831608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] PATH_INFO: `/v3/users/f6770bc9decf4cdab930ed176633e3ed` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:53.833137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6770bc9decf4cdab930ed176633e3ed)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:53.834213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: WARNING py.warnings [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:18:53.834213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: warnings.warn(msg) Aug 31 00:18:53.834213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: Aug 31 00:18:53.842822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:53.978110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852719d6589d4c819ed472a62bed2be2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.978931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852719d6589d4c819ed472a62bed2be2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:53.979775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852719d6589d4c819ed472a62bed2be2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.021716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852719d6589d4c819ed472a62bed2be2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.040877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0353407c-fecb-4a2a-bcfa-f83efc682065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852719d6589d4c819ed472a62bed2be2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.060003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:54.067649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 826/1654] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:18:53 2022] DELETE /identity/v3/users/852719d6589d4c819ed472a62bed2be2 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:54.072144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6770bc9decf4cdab930ed176633e3ed'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.084337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6770bc9decf4cdab930ed176633e3ed'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.140681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6770bc9decf4cdab930ed176633e3ed'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.141962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6770bc9decf4cdab930ed176633e3ed'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.157924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6770bc9decf4cdab930ed176633e3ed'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:54.167627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 829/1655] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:18:53 2022] DELETE /identity/v3/users/f6770bc9decf4cdab930ed176633e3ed => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:54.172607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1100-ed18-4998-8356-a5b5907f088b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:54.173039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1100-ed18-4998-8356-a5b5907f088b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:54.173446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1100-ed18-4998-8356-a5b5907f088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:54.216262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b91c1100-ed18-4998-8356-a5b5907f088b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:54.217548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b91c1100-ed18-4998-8356-a5b5907f088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:54.348909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 827/1656] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:54.381450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:54.384121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:54.528766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0d60-fbb1-4a67-b023-49e0bc5068a3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:54.532903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:54.533806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:54.534212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:54.534667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:54.549621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:54.558790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:54.579519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145e27-565c-4b65-8722-7fffab4b7413 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:54.579965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145e27-565c-4b65-8722-7fffab4b7413 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:54.581667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145e27-565c-4b65-8722-7fffab4b7413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:54.595293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 830/1657] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:54.627610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-19145e27-565c-4b65-8722-7fffab4b7413 None None] MFA Rules not processed for user `2009aaaff1864bf786aa44c097758e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:54.629018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-19145e27-565c-4b65-8722-7fffab4b7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:54.789835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 828/1658] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:55.556372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:55.557766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:55.580873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec2570-f3e8-4630-a285-bfe82cc99ffd service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:55.592426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:55.593280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:55.593708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:55.594162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] PATH_INFO: `/v3/projects/74a9e939ff584ddf9eee5eb9ffb44494` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:55.595696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a9e939ff584ddf9eee5eb9ffb44494)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:55.598023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:55.711478 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a9e939ff584ddf9eee5eb9ffb44494', 'request_id': 'req-dc4d0cb3-de98-432a-aa42-e34b57050ec1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:55.734937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a9e939ff584ddf9eee5eb9ffb44494', 'request_id': 'req-dc4d0cb3-de98-432a-aa42-e34b57050ec1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:55.741511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a9e939ff584ddf9eee5eb9ffb44494', 'request_id': 'req-dc4d0cb3-de98-432a-aa42-e34b57050ec1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:55.765745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:55.771860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] The token cache is being invalidate because project 74a9e939ff584ddf9eee5eb9ffb44494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:18:55.772886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:55.774622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:55.777193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 831/1659] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:18:55 2022] DELETE /identity/v3/projects/74a9e939ff584ddf9eee5eb9ffb44494 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:55.782611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dfd5e-a317-4704-8af5-77a2db806e0a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:55.783111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dfd5e-a317-4704-8af5-77a2db806e0a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:55.783246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dfd5e-a317-4704-8af5-77a2db806e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:55.827648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8a1dfd5e-a317-4704-8af5-77a2db806e0a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:55.834532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8a1dfd5e-a317-4704-8af5-77a2db806e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:55.934356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:55.936663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:55.969447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 829/1660] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:55.979147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:55.981047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:55.981331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.046699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:56.049760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:56.088004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 830/1661] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:56.091711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.129831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb59115-77e4-44f1-827a-d6f536fe0fb8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.148750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.149246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.149528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.149949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.150630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:18:56.152143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.156453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.165564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0cb3-de98-432a-aa42-e34b57050ec1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.206593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 831/1662] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:56.207967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.213129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.214327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.214789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.215213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] PATH_INFO: `/v3/projects/6964278bedc24b9eaae22c6404f97641` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.220649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6964278bedc24b9eaae22c6404f97641)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.223112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.233260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:56.247160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa17b-dabe-4c2f-838f-08177670dff2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.261045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.262984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.263492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.265388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.267749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.274056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.341488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6964278bedc24b9eaae22c6404f97641', 'request_id': 'req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.349685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6964278bedc24b9eaae22c6404f97641', 'request_id': 'req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.353888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 832/1663] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:56 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:56.358831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.369480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6964278bedc24b9eaae22c6404f97641', 'request_id': 'req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.398849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] The token cache is being invalidate because project 6964278bedc24b9eaae22c6404f97641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:18:56.399160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.412536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.418053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 832/1664] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:18:55 2022] DELETE /identity/v3/projects/6964278bedc24b9eaae22c6404f97641 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:18:56.422158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.426374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:56.546332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c9f12-80a2-4a27-bc29-b9711bd7d2ae admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.559666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.560900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.561269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.562733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.563480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.570597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.607673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d6ab-cb7b-4b7b-a4f9-63a3c634ae71 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.618087 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.619042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.619578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.620024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] PATH_INFO: `/v3/users/c51f5869278a4900b97e72c4f2325c5b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.622149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51f5869278a4900b97e72c4f2325c5b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.624622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.639178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 833/1665] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:56 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:56.644041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.647199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:56.678001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5fcb-3c68-48e0-8131-104a91779780 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.680152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:56.701313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.702573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.702852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.705649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.706209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51f5869278a4900b97e72c4f2325c5b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.710129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.712360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.719775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51f5869278a4900b97e72c4f2325c5b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.739215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51f5869278a4900b97e72c4f2325c5b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.740321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51f5869278a4900b97e72c4f2325c5b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.744676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 834/1666] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:18:56.745943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.753105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51f5869278a4900b97e72c4f2325c5b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:18:56.764731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 833/1667] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:18:56 2022] DELETE /identity/v3/users/c51f5869278a4900b97e72c4f2325c5b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:56.768492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ad998-3295-46d7-b7f4-b51fc6c71f9d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.932967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06d3e4-8314-42b8-b5bb-a06ff6fedbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.933602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d3e4-8314-42b8-b5bb-a06ff6fedbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.933908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d3e4-8314-42b8-b5bb-a06ff6fedbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.934190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06d3e4-8314-42b8-b5bb-a06ff6fedbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:56.934839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06d3e4-8314-42b8-b5bb-a06ff6fedbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:56.936458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06d3e4-8314-42b8-b5bb-a06ff6fedbb1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:56.954337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 835/1668] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:18:56.957367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:56.959045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:56.986577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff82e-fc92-4df9-b2bc-721c253026d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:56.998726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:56.999419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:56.999702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:56.999979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] PATH_INFO: `/v3/projects/d57d3ecb7d4f4b819e1f5c8669d84d22/users/9676c9d1846341b5ac7435c2b9535978/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.035900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57d3ecb7d4f4b819e1f5c8669d84d22, user_id=9676c9d1846341b5ac7435c2b9535978, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:57.058821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:57.098114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 834/1669] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:56 2022] PUT /identity/v3/projects/d57d3ecb7d4f4b819e1f5c8669d84d22/users/9676c9d1846341b5ac7435c2b9535978/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:57.119963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.120820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.121477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.196935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] MFA Rules not processed for user `9676c9d1846341b5ac7435c2b9535978`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:57.198293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:57.311378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:57.344125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 836/1670] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:57.349413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:57.509715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeba61-11b9-4b87-ada4-c6547adb86c9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:57.528564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:57.529158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.529525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.529698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.530393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:57.543051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:57.630333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 835/1671] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:18:57 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:57.634449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:57.649650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a5bfd-ed3a-4859-a81f-7873582d848b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:57.800305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:57.802143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.802916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.803930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.804607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:57.808819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:57.860587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:57.861888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 837/1672] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:18:57 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:18:57.877256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed033e-d1d2-4089-8463-c3fe18ef4ae6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:57.890621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:57.891238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.891519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.891794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.892452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:57.894164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:57.921540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 836/1673] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:18:57.926555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:57.958891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d91e69-aff4-43cb-b72b-c9eee1d0096f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:57.972964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:57.973660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.974511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.974511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] PATH_INFO: `/v3/projects/b7722f0924594c98baa1a3637444adc8/users/5ac6f0545c0048e09774c9b7ef298070/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.022926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7722f0924594c98baa1a3637444adc8, user_id=5ac6f0545c0048e09774c9b7ef298070, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:58.025809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:58.051081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 838/1674] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:57 2022] PUT /identity/v3/projects/b7722f0924594c98baa1a3637444adc8/users/5ac6f0545c0048e09774c9b7ef298070/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:58.051836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:58.069025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c5149-336b-4675-8e77-5a3d7d3b9a02 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:58.196576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:58.219731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b30ab-f7ca-4e7f-8f4e-c074c80481ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:58.222496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b30ab-f7ca-4e7f-8f4e-c074c80481ff admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.222839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b30ab-f7ca-4e7f-8f4e-c074c80481ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.223116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b30ab-f7ca-4e7f-8f4e-c074c80481ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.223854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b30ab-f7ca-4e7f-8f4e-c074c80481ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:58.225958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b30ab-f7ca-4e7f-8f4e-c074c80481ff admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:58.258633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 837/1675] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:18:58.260611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:58.279770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32529dfe-433a-4640-a88d-fad8e866a643 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:58.294178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc799c-f1c1-49a7-b835-6932bd6b09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:58.296170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc799c-f1c1-49a7-b835-6932bd6b09fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.297452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc799c-f1c1-49a7-b835-6932bd6b09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.299661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc799c-f1c1-49a7-b835-6932bd6b09fc admin admin] PATH_INFO: `/v3/projects/b7722f0924594c98baa1a3637444adc8/users/5ac6f0545c0048e09774c9b7ef298070/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.307918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc799c-f1c1-49a7-b835-6932bd6b09fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7722f0924594c98baa1a3637444adc8, user_id=5ac6f0545c0048e09774c9b7ef298070, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:58.321837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc799c-f1c1-49a7-b835-6932bd6b09fc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:58.368542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 839/1676] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:18:58 2022] PUT /identity/v3/projects/b7722f0924594c98baa1a3637444adc8/users/5ac6f0545c0048e09774c9b7ef298070/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:18:58.370896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.371591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.372013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.392490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11b52-7fa9-47e3-8b7e-447c6ce18834 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.393042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11b52-7fa9-47e3-8b7e-447c6ce18834 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.393458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11b52-7fa9-47e3-8b7e-447c6ce18834 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.395438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 840/1677] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:58.413244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.414130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.414547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.462942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:58.466454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:58.472977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] MFA Rules not processed for user `5ac6f0545c0048e09774c9b7ef298070`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:58.477040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:58.637751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 841/1678] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:18:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:58.662027 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 838/1679] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:18:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:58.681390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:58.683213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:58.766489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:58.768484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:58.779223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:58.795090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9496-ad60-4a41-a497-340c4596b2a2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:58.819749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:58.821560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.822213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.822710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.845331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:58.847475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:58.849933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b619b-eb18-4e8b-a886-021125d76161 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:58.870907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:58.871912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:58.872193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:58.872466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:58.873821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 839/1680] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:58.998164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:58.999650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:59.021330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 842/1681] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:00.691801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:00.695877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:00.923716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da717e-ac20-4bda-87f9-4c4ac48bb4a9 service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:00.959331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:00.960933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:00.974553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:00.974863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] PATH_INFO: `/v3/projects/4bd991eecbc5444f82fb7b091c4e9da6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:00.980645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd991eecbc5444f82fb7b091c4e9da6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:00.986176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:01.106471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:01.107950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:01.144799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a01e5e-892e-40cd-896b-0c1a5727435b service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:01.186807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd991eecbc5444f82fb7b091c4e9da6', 'request_id': 'req-a977ad7a-0cf6-409f-8baa-d160e2c39f02'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.204462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd991eecbc5444f82fb7b091c4e9da6', 'request_id': 'req-a977ad7a-0cf6-409f-8baa-d160e2c39f02'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.242629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd991eecbc5444f82fb7b091c4e9da6', 'request_id': 'req-a977ad7a-0cf6-409f-8baa-d160e2c39f02'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.258214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:01.282521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] The token cache is being invalidate because project 4bd991eecbc5444f82fb7b091c4e9da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:01.285693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.286704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a977ad7a-0cf6-409f-8baa-d160e2c39f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.288390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 840/1682] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:00 2022] DELETE /identity/v3/projects/4bd991eecbc5444f82fb7b091c4e9da6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:01.295417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0c45-dda1-4739-a514-8717111db2b2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.295763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0c45-dda1-4739-a514-8717111db2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.296150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0c45-dda1-4739-a514-8717111db2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.383350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a9cc0c45-dda1-4739-a514-8717111db2b2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:01.385104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a9cc0c45-dda1-4739-a514-8717111db2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:01.396052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:01.397982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.402824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.403258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] PATH_INFO: `/v3/users/c36c94053c2848d3a149e495a7ec9054` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.407390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36c94053c2848d3a149e495a7ec9054)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:01.409676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:01.412297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 841/1683] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:01.420807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.421087 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.421532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.481381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:01.488179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:01.514189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 842/1684] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:01.515295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:01.551507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36c94053c2848d3a149e495a7ec9054'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.552532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36c94053c2848d3a149e495a7ec9054'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.553346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36c94053c2848d3a149e495a7ec9054'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.557686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e3d09-b782-4d60-b033-603537ab3c04 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:01.572761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:01.573787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.576755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.578034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.580424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:01.581220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:01.585779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b4f71-7a6e-45a2-97b6-e5c42a6b686b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:01.620307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 843/1685] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:01.623821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.624105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.624376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.636792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36c94053c2848d3a149e495a7ec9054'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.650654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36c94053c2848d3a149e495a7ec9054'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:01.704864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 843/1686] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:01 2022] DELETE /identity/v3/users/c36c94053c2848d3a149e495a7ec9054 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:01.709060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:01.712613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:01.737037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] MFA Rules not processed for user `c924dfe7e9c941f9b7110c1a440633dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:01.739885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:01.749900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:01.889876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbda16-3aaf-49c1-bcb4-b7448816bdea admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:01.902473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:01.903284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.903572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.903849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.904519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:01.906527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:01.986440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 844/1687] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:01 2022] POST /identity/v3/projects => generated 367 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:01.986440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:01.987295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:02.039834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 844/1688] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:02.040996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:02.060337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f2f2d-2278-4c20-95fe-6824191dc847 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:02.222548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996fd62-48ff-4829-8636-8cbac9da1b47 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:02.256751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af355e9c-6a83-4018-bfd7-7b66c5eaac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:02.257454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af355e9c-6a83-4018-bfd7-7b66c5eaac08 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.257722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af355e9c-6a83-4018-bfd7-7b66c5eaac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.266716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:02.267390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.267668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.268106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] PATH_INFO: `/v3/users/b245080543f84be9880518049e59809f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.270632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b245080543f84be9880518049e59809f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:02.271696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af355e9c-6a83-4018-bfd7-7b66c5eaac08 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.272978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af355e9c-6a83-4018-bfd7-7b66c5eaac08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:02.274327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:02.275594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af355e9c-6a83-4018-bfd7-7b66c5eaac08 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:02.320537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 845/1689] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:02 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:02.323197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.323485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.323756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.390471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] MFA Rules not processed for user `c924dfe7e9c941f9b7110c1a440633dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:02.394598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:02.421530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b245080543f84be9880518049e59809f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.423413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b245080543f84be9880518049e59809f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.424132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b245080543f84be9880518049e59809f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.461542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:02.462691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b245080543f84be9880518049e59809f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.478594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b245080543f84be9880518049e59809f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.487078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 846/1690] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:02.487078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:02.487078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:02.507674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e4a9b-2eee-4ef5-8ffd-867f2e1a700a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:02.523348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 845/1691] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:01 2022] DELETE /identity/v3/users/b245080543f84be9880518049e59809f => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:02.530607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:02.535791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:02.586973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:02.639455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:02.640112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.640390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.640899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] PATH_INFO: `/v3/projects/db63eceb5e424414949d2f32d89971ec` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.642134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db63eceb5e424414949d2f32d89971ec)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:02.644135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:02.712054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f163-fc66-4d08-9cc0-66ebd1f6255e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:02.716010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db63eceb5e424414949d2f32d89971ec', 'request_id': 'req-9fb3e628-9a53-49ee-9087-fc3340150a1f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.725461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db63eceb5e424414949d2f32d89971ec', 'request_id': 'req-9fb3e628-9a53-49ee-9087-fc3340150a1f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.738330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db63eceb5e424414949d2f32d89971ec', 'request_id': 'req-9fb3e628-9a53-49ee-9087-fc3340150a1f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.776678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] The token cache is being invalidate because project db63eceb5e424414949d2f32d89971ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:02.777287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.779168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fb3e628-9a53-49ee-9087-fc3340150a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:02.783059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 847/1692] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:02 2022] DELETE /identity/v3/projects/db63eceb5e424414949d2f32d89971ec => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:02.791432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2029fe-116e-40b7-98e4-fe6f1d039cc9 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.791783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2029fe-116e-40b7-98e4-fe6f1d039cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.792003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2029fe-116e-40b7-98e4-fe6f1d039cc9 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.799147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 848/1693] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 00:19:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:02.801249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf489e-962b-401f-991e-4ae81e9e34cf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.801534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf489e-962b-401f-991e-4ae81e9e34cf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.801807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf489e-962b-401f-991e-4ae81e9e34cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.846643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:02.847276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.847555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.847997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.869066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:02.870452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:02.885819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-20bf489e-962b-401f-991e-4ae81e9e34cf None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:02.888238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-20bf489e-962b-401f-991e-4ae81e9e34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:02.906139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 846/1694] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:02.906768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:02.913839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:02.916762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 849/1695] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:02.918189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.918471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.918737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.943393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1856c6-37b6-4a5a-8aad-7e707b965ea5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:02.957374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:02.958060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:02.958340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:02.958614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] PATH_INFO: `/v3/users/2009aaaff1864bf786aa44c097758e88` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:02.966706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2009aaaff1864bf786aa44c097758e88)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:02.968683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.019728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:03.022920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.068662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2009aaaff1864bf786aa44c097758e88'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:03.069513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2009aaaff1864bf786aa44c097758e88'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:03.072132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2009aaaff1864bf786aa44c097758e88'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:03.120297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2009aaaff1864bf786aa44c097758e88'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:03.136225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2009aaaff1864bf786aa44c097758e88'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:03.162711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 847/1696] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:02 2022] DELETE /identity/v3/users/2009aaaff1864bf786aa44c097758e88 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:03.170913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:03.179075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.202626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:03.230557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 850/1697] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 00:19:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:03.231610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:03.235550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.273503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:03.364657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf4d6-b1c7-4987-9563-403d6514c2c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:03.391593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:03.392244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.392521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.392803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.393474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:03.395154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.402853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb706af8-cf1f-4852-929f-98e28ede68e7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:03.418739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 848/1698] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:03.419335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:03.534524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:03.535905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.536429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.536899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.540956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.567400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:03.576395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.598527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 851/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:03.600818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:03.620213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848afb-c06a-49ed-8dfb-a1038312f5e6 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:03.639456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7616d-a1f8-40d9-a7df-9e4f419e690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:03.640577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7616d-a1f8-40d9-a7df-9e4f419e690a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.640979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7616d-a1f8-40d9-a7df-9e4f419e690a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.640979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7616d-a1f8-40d9-a7df-9e4f419e690a admin admin] PATH_INFO: `/v3/projects/19d5a5f84cb943b7baf03bab52507c7b/users/0c1cb99929284380bcd196899f3a74c7/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.644319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bc9b-35a4-4199-8c1d-1327e6759d29 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:03.667807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7616d-a1f8-40d9-a7df-9e4f419e690a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d5a5f84cb943b7baf03bab52507c7b, user_id=0c1cb99929284380bcd196899f3a74c7, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:03.673401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7616d-a1f8-40d9-a7df-9e4f419e690a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.675341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:03.675980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.676406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.676692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.687443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.739923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 852/1700] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:03 2022] PUT /identity/v3/projects/19d5a5f84cb943b7baf03bab52507c7b/users/0c1cb99929284380bcd196899f3a74c7/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:03.743081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8057c-8a17-4501-a12c-f73c21540ab7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:03.745968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8057c-8a17-4501-a12c-f73c21540ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:03.746362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8057c-8a17-4501-a12c-f73c21540ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:03.849670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cab8057c-8a17-4501-a12c-f73c21540ab7 None None] MFA Rules not processed for user `0c1cb99929284380bcd196899f3a74c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:03.854098 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cab8057c-8a17-4501-a12c-f73c21540ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:03.900204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:03.903247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:03.935468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 849/1701] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:04.027614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 853/1702] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:04.033197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:04.053278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720e7ff-519a-4956-8eb4-f958467bd6d2 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:04.227850 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.228097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.228374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.230999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:04.232513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.232798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.233069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.233771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:04.236418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:04.254835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:04.317546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 850/1703] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:04 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:04.320746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:04.322116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] MFA Rules not processed for user `a76438b57a2140cca853e0e71fb28f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:04.327527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:04.368947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:04.526584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ca6a4-78ea-4f9b-8c4d-1fa54005c005 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:04.549063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785567-c512-499d-8d18-7a41f1361845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:04.549865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785567-c512-499d-8d18-7a41f1361845 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.550311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785567-c512-499d-8d18-7a41f1361845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.550531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785567-c512-499d-8d18-7a41f1361845 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.570584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0785567-c512-499d-8d18-7a41f1361845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:04.575957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0785567-c512-499d-8d18-7a41f1361845 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:04.578190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 854/1704] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:04.604809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:04.606425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:04.625947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 851/1705] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:04 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:04.627564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348610e-7a59-41d0-8dc6-37585327584d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.628091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348610e-7a59-41d0-8dc6-37585327584d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.628370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348610e-7a59-41d0-8dc6-37585327584d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.629694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 852/1706] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 31 00:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:04.633004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348610e-7a59-41d0-8dc6-37585327584d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:04.651145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02df9d-03fa-47e4-9a84-93dcc55a2d80 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:04.663097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:04.663768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.664051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.664326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] PATH_INFO: `/v3/projects/f1b21b0fc83046bba171c458e6c347c9` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.670705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b21b0fc83046bba171c458e6c347c9)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:04.672698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:04.686216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348610e-7a59-41d0-8dc6-37585327584d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:04.701432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faff644-8fbb-4825-8612-154b5091bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:04.702278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faff644-8fbb-4825-8612-154b5091bd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.702634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faff644-8fbb-4825-8612-154b5091bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.703118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faff644-8fbb-4825-8612-154b5091bd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.704123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faff644-8fbb-4825-8612-154b5091bd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:04.717937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faff644-8fbb-4825-8612-154b5091bd44 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:04.773039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 853/1707] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:04.793547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8b80-e6cf-45d6-978e-f871dc9e4c4b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.797357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8b80-e6cf-45d6-978e-f871dc9e4c4b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.798219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8b80-e6cf-45d6-978e-f871dc9e4c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.826049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b21b0fc83046bba171c458e6c347c9', 'request_id': 'req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:04.843351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b21b0fc83046bba171c458e6c347c9', 'request_id': 'req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:04.869476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b21b0fc83046bba171c458e6c347c9', 'request_id': 'req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:04.886726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] The token cache is being invalidate because project f1b21b0fc83046bba171c458e6c347c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:04.887019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:04.887694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ca5bdbc-5f61-4f91-8dc5-fcda20c15014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:04.893838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 855/1708] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:04 2022] DELETE /identity/v3/projects/f1b21b0fc83046bba171c458e6c347c9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:04.895808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842544ed-0d7b-4e51-9f2b-70f6c5d87ff3 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:04.896206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842544ed-0d7b-4e51-9f2b-70f6c5d87ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:04.896553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842544ed-0d7b-4e51-9f2b-70f6c5d87ff3 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:04.898989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e89e8b80-e6cf-45d6-978e-f871dc9e4c4b None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:04.899124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 856/1709] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 00:19:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:04.899851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842544ed-0d7b-4e51-9f2b-70f6c5d87ff3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:04.902209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-842544ed-0d7b-4e51-9f2b-70f6c5d87ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:04.905469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e89e8b80-e6cf-45d6-978e-f871dc9e4c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.007793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842544ed-0d7b-4e51-9f2b-70f6c5d87ff3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:05.021506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae85f-c219-43d0-8c70-11d271075423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:05.022951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae85f-c219-43d0-8c70-11d271075423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.023393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae85f-c219-43d0-8c70-11d271075423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.023714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae85f-c219-43d0-8c70-11d271075423 admin admin] PATH_INFO: `/v3/projects/1a3eeb7f29fd4f5fa08a978bb9c5ac3f/users/5303f4935f964742b9638a38c206d668/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.067572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae85f-c219-43d0-8c70-11d271075423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3eeb7f29fd4f5fa08a978bb9c5ac3f, user_id=5303f4935f964742b9638a38c206d668, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:05.070954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ae85f-c219-43d0-8c70-11d271075423 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:05.089420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 854/1710] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 31 00:19:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:05.093004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.093293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.093614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.111477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 857/1711] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:04 2022] PUT /identity/v3/projects/1a3eeb7f29fd4f5fa08a978bb9c5ac3f/users/5303f4935f964742b9638a38c206d668/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:05.113834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.114749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.115215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.149962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:05.151239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.160693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:05.162349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.181711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:05.303727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:05.335986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 855/1712] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:05.337223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:05.339058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.344114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 858/1713] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:05.345045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:05.388440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d4f4f-fd88-40d7-97b5-e0d1b0bb20ed None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:05.414778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:05.415422 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.415973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.415973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.420608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.540784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef18760-c011-4560-b3f5-efde88239d0f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:05.550288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:05.551778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.552061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.554130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.558389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.624793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:05.629426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:05.669362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 859/1714] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:05.673744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:05.709683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30402bd7-8a3e-448d-b4f7-4941b7502838 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:05.726583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5039bb-2660-4f66-a0e1-2916bf460c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:05.730107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5039bb-2660-4f66-a0e1-2916bf460c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.730655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5039bb-2660-4f66-a0e1-2916bf460c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.733062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5039bb-2660-4f66-a0e1-2916bf460c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.733971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5039bb-2660-4f66-a0e1-2916bf460c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:05.736557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5039bb-2660-4f66-a0e1-2916bf460c84 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:05.790320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 860/1715] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:05.793728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.794857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.795607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.826741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:05.828419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:05.861135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:05.865704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.876485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 856/1716] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:05.878043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:05.881519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.903924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 861/1717] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:05.918747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:05.964622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5f2a-e9ec-4016-8050-105ba76c8164 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:05.985807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:05.987138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.987524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.988063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] PATH_INFO: `/v3/projects/1a3eeb7f29fd4f5fa08a978bb9c5ac3f/users/5303f4935f964742b9638a38c206d668/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.995740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3eeb7f29fd4f5fa08a978bb9c5ac3f, user_id=5303f4935f964742b9638a38c206d668, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.002424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.045706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 862/1718] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:05 2022] PUT /identity/v3/projects/1a3eeb7f29fd4f5fa08a978bb9c5ac3f/users/5303f4935f964742b9638a38c206d668/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:06.047133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:06.195499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98444727-4624-4750-ab34-feb20bb136d0 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:06.297238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cb8f0-221a-4886-bb79-8fad8c8a67c9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:06.304078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:06.304756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.306055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.306335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.306999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:06.307474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.309636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.329515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 863/1719] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:06.329515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:06.343871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:06.368942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dab5f1-469c-4a48-b749-3af26096ee14 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:06.379416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:06.380300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.380774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.381372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] PATH_INFO: `/v3/projects/7dadd80d2dde4b8db7db81f804c0a35f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.383928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:06.384612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dadd80d2dde4b8db7db81f804c0a35f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.396379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.402848 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:06.417165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:06.417382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.423285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.423450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.486588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dadd80d2dde4b8db7db81f804c0a35f', 'request_id': 'req-01056bb5-d5e7-4dbc-a0a7-047c48783be8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:06.503276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dadd80d2dde4b8db7db81f804c0a35f', 'request_id': 'req-01056bb5-d5e7-4dbc-a0a7-047c48783be8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:06.520443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dadd80d2dde4b8db7db81f804c0a35f', 'request_id': 'req-01056bb5-d5e7-4dbc-a0a7-047c48783be8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:06.546970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] The token cache is being invalidate because project 7dadd80d2dde4b8db7db81f804c0a35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:06.547645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:06.548491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-01056bb5-d5e7-4dbc-a0a7-047c48783be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:06.552744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 864/1720] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:06 2022] DELETE /identity/v3/projects/7dadd80d2dde4b8db7db81f804c0a35f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:06.557308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.557998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.558281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.666517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.667996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.697236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 857/1721] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:06.698481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:06.702031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] MFA Rules not processed for user `5303f4935f964742b9638a38c206d668`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:06.706148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:06.750867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325b7d-b078-4dc5-8f2c-c081a1c73eca service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:06.892306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef571f29-bf25-4d28-9de7-260729d4d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:06.894498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef571f29-bf25-4d28-9de7-260729d4d8fe admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.895885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef571f29-bf25-4d28-9de7-260729d4d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.901139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 865/1722] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:06.901139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:06.901734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:06.903724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef571f29-bf25-4d28-9de7-260729d4d8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.904890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef571f29-bf25-4d28-9de7-260729d4d8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.908293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef571f29-bf25-4d28-9de7-260729d4d8fe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.931060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b505c45-ccf4-43f3-9f96-08d280377b2d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:06.936560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:06.937217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.937493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.937762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] PATH_INFO: `/v3/users/ce027e59939f44d5b2dfbae293a7aa1e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.940148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce027e59939f44d5b2dfbae293a7aa1e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.942275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.998906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 858/1723] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:06 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:07.001999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.002591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.004257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.034989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce027e59939f44d5b2dfbae293a7aa1e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:07.044320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] MFA Rules not processed for user `ced4ad031f324edb89eff6133fbf9543`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:07.046074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.051874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce027e59939f44d5b2dfbae293a7aa1e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:07.068254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce027e59939f44d5b2dfbae293a7aa1e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:07.074918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce027e59939f44d5b2dfbae293a7aa1e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:07.076768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:07.095836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ed8e397f-308b-4a7a-a809-8fd3957f5d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce027e59939f44d5b2dfbae293a7aa1e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:07.106728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 866/1724] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:06 2022] DELETE /identity/v3/users/ce027e59939f44d5b2dfbae293a7aa1e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:07.107975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.108541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.108828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.154109 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:07.161973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 859/1725] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:07.163387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.165819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.191945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] MFA Rules not processed for user `3f519b1d9a1149169b8142e738320a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:07.193524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.249441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d2259-e52b-413e-bff4-32c03d025116 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.324817 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.325461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.325741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.326218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.329203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 867/1726] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:07.330316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.337904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.338108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.473065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96452c4a-49cb-4b35-aa90-39a2563dcb39 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.476090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:07.477824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ef377-4656-4a37-9c66-66b848783585 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:07.478452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.479068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.479355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.479634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.480274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:07.482387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:07.504675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 860/1727] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:07.509206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a8842-700e-474b-9851-f5c57672d343 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.509522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a8842-700e-474b-9851-f5c57672d343 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.509806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a8842-700e-474b-9851-f5c57672d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.533619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 868/1728] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:07 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:07.535047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.540774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.570978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-288a8842-700e-474b-9851-f5c57672d343 None None] MFA Rules not processed for user `ced4ad031f324edb89eff6133fbf9543`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:07.572489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-288a8842-700e-474b-9851-f5c57672d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.655667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 861/1729] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:07.658621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a8842-700e-474b-9851-f5c57672d343 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.679074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a8842-700e-474b-9851-f5c57672d343 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.688339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.689288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.690443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.691222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.692075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:07.694863 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:07.702526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:07.712523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 862/1730] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:07.713940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.717703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.730108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040f90-be95-440b-a500-626fac155fd0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.737491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10177124-c3ad-4baa-9cfc-dfd5bac4b044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.738401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10177124-c3ad-4baa-9cfc-dfd5bac4b044 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.738784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10177124-c3ad-4baa-9cfc-dfd5bac4b044 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.739188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10177124-c3ad-4baa-9cfc-dfd5bac4b044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.739381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713433e4-6fcb-4ce4-953d-c0bbf06e4574 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.747530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:07.750110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10177124-c3ad-4baa-9cfc-dfd5bac4b044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:07.750488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.751464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.751941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.752367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.753165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10177124-c3ad-4baa-9cfc-dfd5bac4b044 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:07.755470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:07.769340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 869/1731] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:07.771313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5133de-38ec-4d14-abc6-9284e75baa5d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.771906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5133de-38ec-4d14-abc6-9284e75baa5d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.772514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5133de-38ec-4d14-abc6-9284e75baa5d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.774588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 870/1732] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 00:19:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:07.775583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5133de-38ec-4d14-abc6-9284e75baa5d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.807692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5133de-38ec-4d14-abc6-9284e75baa5d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.817728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff506-79b8-4dcd-aafa-4f2fdc86cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.819160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff506-79b8-4dcd-aafa-4f2fdc86cbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.820137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff506-79b8-4dcd-aafa-4f2fdc86cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.821312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff506-79b8-4dcd-aafa-4f2fdc86cbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.823164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff506-79b8-4dcd-aafa-4f2fdc86cbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:07.833746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff506-79b8-4dcd-aafa-4f2fdc86cbf2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:07.858709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 871/1733] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:07.864318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d462-0669-47a1-bfce-e9979a4fb8fe None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.864614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d462-0669-47a1-bfce-e9979a4fb8fe None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.868794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d462-0669-47a1-bfce-e9979a4fb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.894680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:07.896516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:07.911699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 863/1734] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:07.912819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:07.951001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd39d2-b402-4397-8401-e253deb120d1 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:07.970624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:07.971855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.971855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.972050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] PATH_INFO: `/v3/projects/2cedc66af1f34b7d9879716192985b35/users/eb0b20485a664bf697627f9f7dfe0c33/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.007107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cedc66af1f34b7d9879716192985b35, user_id=eb0b20485a664bf697627f9f7dfe0c33, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.009800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.010165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ccb6d462-0669-47a1-bfce-e9979a4fb8fe None None] MFA Rules not processed for user `f83352aa0c3843e09f2a666b753a7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:08.011493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ccb6d462-0669-47a1-bfce-e9979a4fb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:08.039680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 864/1735] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:07 2022] PUT /identity/v3/projects/2cedc66af1f34b7d9879716192985b35/users/eb0b20485a664bf697627f9f7dfe0c33/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:08.040594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:08.196708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e82e17-8a13-4ba6-8af7-01934aa15d40 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:08.201304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 872/1736] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:08.203259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.203745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.204246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.214783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:08.215444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.215728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.217039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.278443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] MFA Rules not processed for user `eb0b20485a664bf697627f9f7dfe0c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:08.280256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:08.391975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.394205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.432362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 865/1737] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:08.433327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:08.436589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:08.474346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f340c-3cef-4bdf-9750-49899a4e08eb service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:08.486645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:08.489744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.491690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 873/1738] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:08.495374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.495841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:08.496156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.529709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.539268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.548566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:08.575467 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 866/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:08.577273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:08.583269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:08.691546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a54b2-f682-4545-b9e5-62cf38ee2115 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:08.696912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a74cdd-142b-4882-88df-42bbdc21ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:08.697576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74cdd-142b-4882-88df-42bbdc21ba90 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.697876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74cdd-142b-4882-88df-42bbdc21ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.698185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74cdd-142b-4882-88df-42bbdc21ba90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.698821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74cdd-142b-4882-88df-42bbdc21ba90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.700837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74cdd-142b-4882-88df-42bbdc21ba90 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.731794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:08.757127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 874/1740] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:08 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:08.757127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e2385-4307-46bd-b897-777e9bfb392d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.757127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e2385-4307-46bd-b897-777e9bfb392d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.757606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e2385-4307-46bd-b897-777e9bfb392d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.760991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 875/1741] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 00:19:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:08.768641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e2385-4307-46bd-b897-777e9bfb392d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:08.792950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2509-cc6d-46e9-9956-d8d541f832eb service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:08.892423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:08.893087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.893428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.893763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] PATH_INFO: `/v3/projects/88e6f9c44eca4ea6affc9ebedbed9bca` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.896260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e6f9c44eca4ea6affc9ebedbed9bca)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.898191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: WARNING py.warnings [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:19:08.898191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: warnings.warn(msg) Aug 31 00:19:08.898191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: Aug 31 00:19:08.901242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.903345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e2385-4307-46bd-b897-777e9bfb392d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:08.917187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7eeed-9be3-4116-ac79-5dc012f53ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:08.917929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7eeed-9be3-4116-ac79-5dc012f53ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.918284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7eeed-9be3-4116-ac79-5dc012f53ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.918625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7eeed-9be3-4116-ac79-5dc012f53ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.919332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7eeed-9be3-4116-ac79-5dc012f53ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.921386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7eeed-9be3-4116-ac79-5dc012f53ea4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.962891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 876/1742] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:08 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:08.966619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f034a0-ecbd-4b36-90e2-917acab6b002 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.967312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f034a0-ecbd-4b36-90e2-917acab6b002 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.968313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f034a0-ecbd-4b36-90e2-917acab6b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.015739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-78f034a0-ecbd-4b36-90e2-917acab6b002 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:09.018475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-78f034a0-ecbd-4b36-90e2-917acab6b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:09.048225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e6f9c44eca4ea6affc9ebedbed9bca', 'request_id': 'req-f9157f7a-a140-4289-8955-eb48450cd607'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:09.072814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e6f9c44eca4ea6affc9ebedbed9bca', 'request_id': 'req-f9157f7a-a140-4289-8955-eb48450cd607'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:09.085593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e6f9c44eca4ea6affc9ebedbed9bca', 'request_id': 'req-f9157f7a-a140-4289-8955-eb48450cd607'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:09.105414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] The token cache is being invalidate because project 88e6f9c44eca4ea6affc9ebedbed9bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:09.105709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:09.106445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:09.111834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 867/1743] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:08 2022] DELETE /identity/v3/projects/88e6f9c44eca4ea6affc9ebedbed9bca => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:09.112746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.114516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:09.168836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 877/1744] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:09.170684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.171026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.171542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.208795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:09.212578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:09.237963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:09.298086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157f7a-a140-4289-8955-eb48450cd607 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.309766 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.311625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.311919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.314335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.315029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:09.316986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:09.342933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 868/1745] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:09.342933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.347358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:09.349972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 878/1746] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:09.350761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.368280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ea86c-f20d-489c-8c68-3355455a87b4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.383409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17f2c-8f1d-4c72-abe0-487b272f8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.384317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17f2c-8f1d-4c72-abe0-487b272f8351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.384635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17f2c-8f1d-4c72-abe0-487b272f8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.385079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17f2c-8f1d-4c72-abe0-487b272f8351 admin admin] PATH_INFO: `/v3/projects/35cc2e2c61f74b7aa00fb8d2778bf135/users/3095ceb9d51a4c7ba640c4556ffa8d05/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.410872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:09.416155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df17f2c-8f1d-4c72-abe0-487b272f8351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cc2e2c61f74b7aa00fb8d2778bf135, user_id=3095ceb9d51a4c7ba640c4556ffa8d05, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:09.424146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df17f2c-8f1d-4c72-abe0-487b272f8351 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:09.452659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 879/1747] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:09 2022] PUT /identity/v3/projects/35cc2e2c61f74b7aa00fb8d2778bf135/users/3095ceb9d51a4c7ba640c4556ffa8d05/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:09.452659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.452659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.452659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.499491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:09.503967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:09.541307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57074-aaa7-4056-a52a-18ae71f0810a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.625977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 880/1748] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:09.626921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.648514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be4e6-8fbe-4094-a846-c16a604675cb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.669888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.674012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.674012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.674012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.674012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:09.674386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:09.692161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.692970 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.697308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.698235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.734247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 881/1749] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:09.734247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.784723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18d72-698e-44ba-98b2-dad10d64731c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.804127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.830255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.830989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.832672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.837314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:09.838125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:09.851347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:09.884716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:09.890358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:09.915769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 882/1750] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:09.916592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.921653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 869/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:09.922765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:09.952603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17791a71-7733-4d7a-8068-68eb6c34fc7a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.964445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16698-f20d-403e-a468-9e589c84f2fe service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:09.972292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32492b26-673f-4cbf-90f3-177441eccbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.972925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492b26-673f-4cbf-90f3-177441eccbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.973390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492b26-673f-4cbf-90f3-177441eccbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.973501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492b26-673f-4cbf-90f3-177441eccbea admin admin] PATH_INFO: `/v3/projects/35cc2e2c61f74b7aa00fb8d2778bf135/users/3095ceb9d51a4c7ba640c4556ffa8d05/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:09.977147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32492b26-673f-4cbf-90f3-177441eccbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cc2e2c61f74b7aa00fb8d2778bf135, user_id=3095ceb9d51a4c7ba640c4556ffa8d05, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:09.979885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32492b26-673f-4cbf-90f3-177441eccbea admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:09.987629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:09.991530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:09.992101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:09.994131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.002962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.008229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.026891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 883/1752] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:09 2022] PUT /identity/v3/projects/35cc2e2c61f74b7aa00fb8d2778bf135/users/3095ceb9d51a4c7ba640c4556ffa8d05/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:10.038388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.038858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.039143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.112102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 870/1753] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:09 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:10.112102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:10.113548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:10.130958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] MFA Rules not processed for user `3095ceb9d51a4c7ba640c4556ffa8d05`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:10.132366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:10.142318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:10.353996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 884/1754] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:10.354980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:10.359385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff23cd-a2d5-4f1c-ac7c-bf35499d1e80 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:10.374694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:10.375321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.375599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.375873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.387187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:10.439029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.439029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39a6b6-a996-4ba6-a48f-f13826127b2d service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.461093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 871/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:10.462568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.462861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.463320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.519634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:10.535762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] MFA Rules not processed for user `c924dfe7e9c941f9b7110c1a440633dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:10.540977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:10.581605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610797b9-4a96-4c86-aa82-44d908999a5b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:10.594710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:10.595361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.595640 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.595914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.596559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.598597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.643574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 885/1756] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:10 2022] POST /identity/v3/users => generated 284 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:10.644537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:10.655082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:10.736141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 872/1757] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:10.740559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:10.791182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38833440-4409-4e33-b23c-feffb03736b9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:10.795216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:10.796231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.796664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.797077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.807643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93639f03-0452-4f52-a842-9ce18cb7d7d3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:10.820189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.820331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:10.821180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.821180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.821480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.821638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.836939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.840714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.850498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 886/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:10.933597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 873/1759] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:10.937249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:10.954289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d915c4-49a7-42f1-b3d2-8b2ff7e2f59a service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:10.960528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662857d2-6c14-40f6-9530-9a5eb51d1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:10.961377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662857d2-6c14-40f6-9530-9a5eb51d1821 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:10.961814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662857d2-6c14-40f6-9530-9a5eb51d1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:10.962271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662857d2-6c14-40f6-9530-9a5eb51d1821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:10.963256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662857d2-6c14-40f6-9530-9a5eb51d1821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:10.965051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662857d2-6c14-40f6-9530-9a5eb51d1821 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:10.994180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.007806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 887/1760] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:11.010267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26411543-ae53-41e0-8ece-538637abe7cd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.022294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.023253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.023693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.024112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] PATH_INFO: `/v3/projects/02b663af814b46388c60ac8782f96dc0/users/e775eec788034e74867e1ccc5217837c/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.062654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b663af814b46388c60ac8782f96dc0, user_id=e775eec788034e74867e1ccc5217837c, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.065674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.090313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 874/1761] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:10 2022] PUT /identity/v3/projects/02b663af814b46388c60ac8782f96dc0/users/e775eec788034e74867e1ccc5217837c/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:11.103280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.105301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.105754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.154344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.156164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:11.173695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] MFA Rules not processed for user `e775eec788034e74867e1ccc5217837c`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:11.180020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:11.281646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8157d1-5731-47a3-802e-d1780ff207d0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.289753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.291681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.296079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.296809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.304433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:11.314116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 888/1762] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:11.318968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.359899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:11.413409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:11.440670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026b036-96b9-4daa-9e19-85e17157298a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.447148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.448841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.458149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c81dd-17b7-4d5f-9c85-ebb4ca041c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.459565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c81dd-17b7-4d5f-9c85-ebb4ca041c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.462007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c81dd-17b7-4d5f-9c85-ebb4ca041c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.462432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c81dd-17b7-4d5f-9c85-ebb4ca041c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.464197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c81dd-17b7-4d5f-9c85-ebb4ca041c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.466324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c81dd-17b7-4d5f-9c85-ebb4ca041c6b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.478247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 875/1763] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:11.522471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 889/1764] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:11 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:11.523626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.538481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad3096-de7e-47f0-b2f5-58c615bcd8f0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.538776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad3096-de7e-47f0-b2f5-58c615bcd8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.539052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad3096-de7e-47f0-b2f5-58c615bcd8f0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.540985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f50530-2c07-49c6-97b0-ec5079511caa service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.544458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 890/1765] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 31 00:19:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:11.552148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.552148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.553162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.602904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] MFA Rules not processed for user `f83352aa0c3843e09f2a666b753a7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:11.604900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:11.681221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.681839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.682142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.687314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.688349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.694346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.710917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 891/1766] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:11.744400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.746431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:11.757506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 876/1767] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:11 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:11.758957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.763865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a554330-4cb3-47c2-ac32-7d2370ba25d2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.774863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.775510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.775791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.776068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.790684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6132b-fb78-419c-af68-bd8a50aa68de admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.797196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.802819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.817829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 892/1768] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:11.819284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.819976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.822087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.822799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.824769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.827510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.858521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 877/1769] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:11.859112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:11.888369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa11f9-1bed-45d6-85b9-7d3bcc40a6f3 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:11.903866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b50e91-dc89-4cd8-8864-da0374c1417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:11.905884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50e91-dc89-4cd8-8864-da0374c1417b admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:11.907014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50e91-dc89-4cd8-8864-da0374c1417b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:11.907818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50e91-dc89-4cd8-8864-da0374c1417b admin admin] PATH_INFO: `/v3/projects/292ffb41b1cb4e61935ad2a11080f799/users/968720d874bb40e9b438ed54b72bfe23/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:11.953527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50e91-dc89-4cd8-8864-da0374c1417b admin admin] RBAC: Authorizing `identity:create_grant(project_id=292ffb41b1cb4e61935ad2a11080f799, user_id=968720d874bb40e9b438ed54b72bfe23, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:11.962966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50e91-dc89-4cd8-8864-da0374c1417b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:11.985343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 893/1770] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:11 2022] PUT /identity/v3/projects/292ffb41b1cb4e61935ad2a11080f799/users/968720d874bb40e9b438ed54b72bfe23/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:11.989153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:12.020140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74333a0-f134-4a6c-9a07-2d18d55bd8ab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:12.079495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:12.079788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:12.080061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:12.133819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] MFA Rules not processed for user `a76438b57a2140cca853e0e71fb28f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:12.137823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:12.229958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eec7f-85f2-48ea-9ebf-d4def8863218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:12.234079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eec7f-85f2-48ea-9ebf-d4def8863218 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:12.234519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eec7f-85f2-48ea-9ebf-d4def8863218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:12.235645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eec7f-85f2-48ea-9ebf-d4def8863218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:12.236569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eec7f-85f2-48ea-9ebf-d4def8863218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:12.238697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eec7f-85f2-48ea-9ebf-d4def8863218 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:12.263299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 894/1771] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:12.272473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 878/1772] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:12.276345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:12.291058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049b75-d551-4d23-9a38-c145a1819897 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:12.305230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:12.305942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:12.306226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:12.309881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] PATH_INFO: `/v3/projects/292ffb41b1cb4e61935ad2a11080f799/users/968720d874bb40e9b438ed54b72bfe23/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:12.316993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=292ffb41b1cb4e61935ad2a11080f799, user_id=968720d874bb40e9b438ed54b72bfe23, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:12.326157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:12.360378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 895/1773] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:12 2022] PUT /identity/v3/projects/292ffb41b1cb4e61935ad2a11080f799/users/968720d874bb40e9b438ed54b72bfe23/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:12.362825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4beda4-c170-45fb-9e37-24b9de5ea6c1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:12.363228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4beda4-c170-45fb-9e37-24b9de5ea6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:12.363634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4beda4-c170-45fb-9e37-24b9de5ea6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:12.510239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5c4beda4-c170-45fb-9e37-24b9de5ea6c1 None None] MFA Rules not processed for user `968720d874bb40e9b438ed54b72bfe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:12.511463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c4beda4-c170-45fb-9e37-24b9de5ea6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:12.587601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:12.800061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 879/1774] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:12.825890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:13.013445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:13.048338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c53f4-afa2-4e97-8921-a19bc213bd5a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:13.061611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:13.062542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:13.063042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:13.063522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:13.078003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:13.079944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:13.098763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 896/1775] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:13.217739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed44e-b884-4fd7-8acb-76f65d236e32 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:13.218363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed44e-b884-4fd7-8acb-76f65d236e32 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:13.218833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed44e-b884-4fd7-8acb-76f65d236e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:13.296574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-128ed44e-b884-4fd7-8acb-76f65d236e32 None None] MFA Rules not processed for user `3f519b1d9a1149169b8142e738320a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:13.300292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-128ed44e-b884-4fd7-8acb-76f65d236e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:13.514160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 880/1776] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:13.593874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:13.595474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:13.810253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a8ed-ba7c-42d6-aa8a-3bb52f4267f1 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:13.840058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:13.841039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:13.841554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:13.842073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] PATH_INFO: `/v3/users/0c1cb99929284380bcd196899f3a74c7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:13.843999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1cb99929284380bcd196899f3a74c7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:13.852577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:14.005144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1cb99929284380bcd196899f3a74c7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:14.029403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1cb99929284380bcd196899f3a74c7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:14.062537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1cb99929284380bcd196899f3a74c7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:14.063773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1cb99929284380bcd196899f3a74c7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:14.099257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1cb99929284380bcd196899f3a74c7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:14.107988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 897/1777] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:13 2022] DELETE /identity/v3/users/0c1cb99929284380bcd196899f3a74c7 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:14.115907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:14.115907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:14.115907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:14.157112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:14.158737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:14.378858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 881/1778] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:14.384914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:14.386635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:14.542346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e7fc6-e94a-47bb-b7a1-4e6e9c82d562 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:14.574615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:14.575489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:14.575952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:14.576548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:14.612863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:14.614458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:14.650195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 898/1779] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:15.545744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:15.547273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:15.572901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da6e83-9c6d-4a0b-8932-5e60e180f797 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:15.578885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:15.579677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.580097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.580373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] PATH_INFO: `/v3/projects/19d5a5f84cb943b7baf03bab52507c7b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.581512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d5a5f84cb943b7baf03bab52507c7b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:15.583572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:15.667338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d5a5f84cb943b7baf03bab52507c7b', 'request_id': 'req-be64eecc-0f16-422a-a43f-1330be885649'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.677241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d5a5f84cb943b7baf03bab52507c7b', 'request_id': 'req-be64eecc-0f16-422a-a43f-1330be885649'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.690429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:15.692966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d5a5f84cb943b7baf03bab52507c7b', 'request_id': 'req-be64eecc-0f16-422a-a43f-1330be885649'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.726067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] The token cache is being invalidate because project 19d5a5f84cb943b7baf03bab52507c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:15.726067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.726251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.729914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 882/1780] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:15 2022] DELETE /identity/v3/projects/19d5a5f84cb943b7baf03bab52507c7b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:15.733318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:15.741752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:15.746446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58644-d485-4d81-8c05-a2eea875749e service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:15.842307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:15.842959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.843240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.843711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] PATH_INFO: `/v3/users/5303f4935f964742b9638a38c206d668` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.845096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5303f4935f964742b9638a38c206d668)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:15.847093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:15.935624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5303f4935f964742b9638a38c206d668'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.946210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5303f4935f964742b9638a38c206d668'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.969568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5303f4935f964742b9638a38c206d668'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.970329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5303f4935f964742b9638a38c206d668'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:15.979486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5303f4935f964742b9638a38c206d668'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.006533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 899/1781] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:15 2022] DELETE /identity/v3/users/5303f4935f964742b9638a38c206d668 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:16.356105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:16.357562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:16.405741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64eecc-0f16-422a-a43f-1330be885649 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:16.436044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:16.437713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:16.547699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:16.548351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:16.550856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:16.551145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] PATH_INFO: `/v3/users/e775eec788034e74867e1ccc5217837c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:16.554069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e775eec788034e74867e1ccc5217837c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:16.556175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:16.567847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233715-8420-426d-9a5b-1b29155b498e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:16.589876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:16.591215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:16.591701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:16.592151 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] PATH_INFO: `/v3/projects/1a3eeb7f29fd4f5fa08a978bb9c5ac3f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:16.593597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3eeb7f29fd4f5fa08a978bb9c5ac3f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:16.595872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:16.671571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e775eec788034e74867e1ccc5217837c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.672649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e775eec788034e74867e1ccc5217837c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.673442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e775eec788034e74867e1ccc5217837c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.678745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:16.727659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e775eec788034e74867e1ccc5217837c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.728864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3eeb7f29fd4f5fa08a978bb9c5ac3f', 'request_id': 'req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.738801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3eeb7f29fd4f5fa08a978bb9c5ac3f', 'request_id': 'req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.747290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d41511b4-386f-4220-becf-0c2153e33eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e775eec788034e74867e1ccc5217837c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.751739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3eeb7f29fd4f5fa08a978bb9c5ac3f', 'request_id': 'req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.783265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] The token cache is being invalidate because project 1a3eeb7f29fd4f5fa08a978bb9c5ac3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:16.783692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.791115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eb70fa7c-b15f-4291-a2a0-9cb9e120caa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:16.793962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 883/1782] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:16 2022] DELETE /identity/v3/users/e775eec788034e74867e1ccc5217837c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:16.799114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 900/1783] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:16 2022] DELETE /identity/v3/projects/1a3eeb7f29fd4f5fa08a978bb9c5ac3f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:16.803047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ee29b-830d-449a-8a98-1f09a11ff768 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:16.803208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:16.803655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:16.804271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:16.804399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ee29b-830d-449a-8a98-1f09a11ff768 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:16.805654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ee29b-830d-449a-8a98-1f09a11ff768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:16.829991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:16.833118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:16.846846 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f41ee29b-830d-449a-8a98-1f09a11ff768 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:16.848389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f41ee29b-830d-449a-8a98-1f09a11ff768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:16.947293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 901/1784] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:16.956468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:16.957011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:16.957473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:16.968948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 884/1785] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:16.984212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:16.985711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:16.993453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.015089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:17.025023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 902/1786] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:17.030078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.047564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:17.059036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbd1d-65a0-4afd-b56a-4130e1fa1147 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.069599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.071331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.072986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.073435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.075685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:17.076163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.081610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.096051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 903/1787] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:17.101497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.125717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28f072-89ce-42b9-8a3d-9563c2481b78 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.128395 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16306-f98e-4a2c-abaa-865f52e8b310 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.135007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.135707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.135991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.136411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.137070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.139275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.139406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.140578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.140929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.141331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.166997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.170065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.183517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 885/1788] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:17.191412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 904/1789] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:17 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:17.195936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.207668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390e60-7bc2-4f56-8caa-5189677b0073 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.331292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.331908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.332184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.332453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.333747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.335856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.366031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 886/1790] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:17 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:17.367276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.379383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a6f8-922e-42d2-a874-ed82d3218531 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.385281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.386440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.386987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.387125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.387807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.389387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.400610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 905/1791] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:17.405681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.421373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943a92-2680-4eec-96bd-bd4145bbf7db admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.426636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb374b61-3e0e-4149-be0b-b9d99d9541bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.427327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb374b61-3e0e-4149-be0b-b9d99d9541bf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.427646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb374b61-3e0e-4149-be0b-b9d99d9541bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.427916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb374b61-3e0e-4149-be0b-b9d99d9541bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.428566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb374b61-3e0e-4149-be0b-b9d99d9541bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.430561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb374b61-3e0e-4149-be0b-b9d99d9541bf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.446652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 887/1792] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:17.451138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.472461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72263b1-c0a1-4e12-856e-97c017d6dac6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.479309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.480115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.480383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.480661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] PATH_INFO: `/v3/projects/184297559bbd46769747a536e4a0172c/users/b2062a5b0735481cbf6ba3277ca4f2ce/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.507490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] RBAC: Authorizing `identity:create_grant(project_id=184297559bbd46769747a536e4a0172c, user_id=b2062a5b0735481cbf6ba3277ca4f2ce, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.531172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.562033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 906/1793] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:17 2022] PUT /identity/v3/projects/184297559bbd46769747a536e4a0172c/users/b2062a5b0735481cbf6ba3277ca4f2ce/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:17.566804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.567298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.567487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.598830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] MFA Rules not processed for user `b2062a5b0735481cbf6ba3277ca4f2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:17.600086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:17.694032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.695928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:17.736187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 888/1794] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:17.741524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:17.746823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:17.768440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:17.783793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62450dc1-df22-45af-a853-18c74e0d117e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.792654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.793500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.794533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.794956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] PATH_INFO: `/v3/projects/02b663af814b46388c60ac8782f96dc0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.796841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b663af814b46388c60ac8782f96dc0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.799424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.854079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ace2-1459-4067-8f77-13189e8a0c96 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:17.904020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b663af814b46388c60ac8782f96dc0', 'request_id': 'req-09c7aff0-5788-49ff-9550-a6c4f979f1d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:17.927502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b663af814b46388c60ac8782f96dc0', 'request_id': 'req-09c7aff0-5788-49ff-9550-a6c4f979f1d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:17.947179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b663af814b46388c60ac8782f96dc0', 'request_id': 'req-09c7aff0-5788-49ff-9550-a6c4f979f1d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:17.952365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:17.953001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:17.953353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:17.953537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:17.954214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:17.956130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:17.983487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] The token cache is being invalidate because project 02b663af814b46388c60ac8782f96dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:17.984577 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:17.987035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:17.989174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 907/1795] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:17 2022] DELETE /identity/v3/projects/02b663af814b46388c60ac8782f96dc0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:18.002944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.006382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 889/1796] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:17 2022] POST /identity/v3/projects => generated 393 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:18.007370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.010371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.013876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.039161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7aff0-5788-49ff-9550-a6c4f979f1d7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.174570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9491ce-ee6c-46eb-be77-e5127ff308b8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.181755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.182597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.183098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.183460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.184153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.186672 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.188086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.188761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.189036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.189305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] PATH_INFO: `/v3/users/968720d874bb40e9b438ed54b72bfe23` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.200226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968720d874bb40e9b438ed54b72bfe23)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.202251 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.242205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 890/1797] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:18 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:18.243843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.263671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9488e-8b2b-4fe4-bfad-250fd756ef84 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.273536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.274549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.275005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.275284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.276953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.278855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.300786 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 891/1798] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:18.301777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.308535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968720d874bb40e9b438ed54b72bfe23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.320513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d451-801e-429a-b666-6325251c3848 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.324385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968720d874bb40e9b438ed54b72bfe23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.328469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.329608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.331373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.331373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] PATH_INFO: `/v3/projects/5bd28df16e9741aab61d53ff89c1ce7b/users/acd40b889adb4a9693e694819e49bbbd/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.348611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:18.352082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968720d874bb40e9b438ed54b72bfe23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.354130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968720d874bb40e9b438ed54b72bfe23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.366550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd28df16e9741aab61d53ff89c1ce7b, user_id=acd40b889adb4a9693e694819e49bbbd, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.371585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.371958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968720d874bb40e9b438ed54b72bfe23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:18.385130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 908/1799] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:18 2022] DELETE /identity/v3/users/968720d874bb40e9b438ed54b72bfe23 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:18.394631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 892/1800] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:18 2022] PUT /identity/v3/projects/5bd28df16e9741aab61d53ff89c1ce7b/users/acd40b889adb4a9693e694819e49bbbd/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:18.395529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.397608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.489572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e747e-9d72-442a-bb81-e4dfa16e4d47 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.496618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446be04-7714-44dc-8437-0b09eace8abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.497252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446be04-7714-44dc-8437-0b09eace8abb admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.497630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446be04-7714-44dc-8437-0b09eace8abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.497953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446be04-7714-44dc-8437-0b09eace8abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.498622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446be04-7714-44dc-8437-0b09eace8abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.500440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446be04-7714-44dc-8437-0b09eace8abb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.520599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.530696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 909/1801] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:18.530904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:18.651420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819605cf-e532-47f3-943b-cab54cd08ec4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.656956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.657707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.658027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.658305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] PATH_INFO: `/v3/projects/5bd28df16e9741aab61d53ff89c1ce7b/users/acd40b889adb4a9693e694819e49bbbd/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.660284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd28df16e9741aab61d53ff89c1ce7b, user_id=acd40b889adb4a9693e694819e49bbbd, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:18.663948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:18.696170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.696456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.696743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.702890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 893/1802] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:18 2022] PUT /identity/v3/projects/5bd28df16e9741aab61d53ff89c1ce7b/users/acd40b889adb4a9693e694819e49bbbd/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:18.748123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] MFA Rules not processed for user `acd40b889adb4a9693e694819e49bbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:18.750326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.863557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 910/1803] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:18.875903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:18.877640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.991098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec83e7-fe80-499b-aa26-60466b1c91cc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:18.994661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:18.995300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.995586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.995865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.010516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.012001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.021905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.023442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.027604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 894/1804] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:19.116890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.120143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.120895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586c15f-c8c7-452d-8483-572f0433c459 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.127014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.127722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.128093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.128424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] PATH_INFO: `/v3/projects/292ffb41b1cb4e61935ad2a11080f799` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.129637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=292ffb41b1cb4e61935ad2a11080f799)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.131787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.132576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343575e2-3f84-490e-84a7-ca12a004aeb9 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.137101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.137811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.138138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.138412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.140440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.150098 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:19.198073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292ffb41b1cb4e61935ad2a11080f799', 'request_id': 'req-973e16ee-479c-41e2-ba68-25ce20b32b9c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.206206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292ffb41b1cb4e61935ad2a11080f799', 'request_id': 'req-973e16ee-479c-41e2-ba68-25ce20b32b9c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.212705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292ffb41b1cb4e61935ad2a11080f799', 'request_id': 'req-973e16ee-479c-41e2-ba68-25ce20b32b9c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.216452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.218676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224540-1d2f-4466-b781-9ab699f475e5 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.228672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] The token cache is being invalidate because project 292ffb41b1cb4e61935ad2a11080f799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:19.229119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.229818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 895/1805] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:19.229957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-973e16ee-479c-41e2-ba68-25ce20b32b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:19.231631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 911/1806] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:19 2022] DELETE /identity/v3/projects/292ffb41b1cb4e61935ad2a11080f799 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:19.242742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.243026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.243302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.264905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:19.266305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.319110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:19.345165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 896/1807] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:19.353687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.354002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.354299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.375579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:19.376811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.386989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 912/1808] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:19.391418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.404507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed99d7-028b-4c7d-ac33-6c7037978cf7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.409736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.410413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.410687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.411006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.412340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:19.412641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.414296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.429027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 897/1809] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:19.433305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.443161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20d54-c4bc-4f08-973c-1e34ffd182ec None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.449581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.450411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.450777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.451025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.451745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.454558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.485806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 913/1810] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:19.490623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.501324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055c376-93bf-42e8-83e3-349f03d43782 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.568289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.568991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.569335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.569692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.570424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.572446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.595349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 898/1811] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:19.599972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.610516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722addd6-efe0-4e3e-8c15-5e9aa803bc4a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.615812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.616416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.616697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.616967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.617614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.619256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.629705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 914/1812] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:19.634147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.645411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab698e1-6a58-4003-8c82-ad72f467e425 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.650986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148286-3476-473b-a187-e272c04fda7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.651626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148286-3476-473b-a187-e272c04fda7e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.652156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148286-3476-473b-a187-e272c04fda7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.652156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148286-3476-473b-a187-e272c04fda7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.652800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148286-3476-473b-a187-e272c04fda7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.654461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148286-3476-473b-a187-e272c04fda7e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.666515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 899/1813] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:19.670728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.681046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd937c15-7e32-4145-8693-58cc6708c477 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.685597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.686267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.686545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.686816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] PATH_INFO: `/v3/projects/04dcd6c57dcd4fa7b98c729636eb6c69/users/39ed6ffe7ded451dbccc7ee5ea9f7c77/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.700842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04dcd6c57dcd4fa7b98c729636eb6c69, user_id=39ed6ffe7ded451dbccc7ee5ea9f7c77, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.703555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.717746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 915/1814] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:19 2022] PUT /identity/v3/projects/04dcd6c57dcd4fa7b98c729636eb6c69/users/39ed6ffe7ded451dbccc7ee5ea9f7c77/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:19.728986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.729277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.729600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.756517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] MFA Rules not processed for user `39ed6ffe7ded451dbccc7ee5ea9f7c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:19.757719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:19.823697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 900/1815] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:19.828028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.892382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae641f-f37c-4c50-bd04-41df9119ec65 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.899252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c59be9-d90b-4d31-8627-c67a811959d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.900542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59be9-d90b-4d31-8627-c67a811959d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.900831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59be9-d90b-4d31-8627-c67a811959d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.901109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59be9-d90b-4d31-8627-c67a811959d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.901788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c59be9-d90b-4d31-8627-c67a811959d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.903735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c59be9-d90b-4d31-8627-c67a811959d6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.939534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 916/1816] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:19.943264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.960734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f7145-1d67-4bbe-8ba7-9510cb043f54 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.034688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:20.064285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.064886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.065226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.065416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.066084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.068618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.076521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.076791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.077062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.124571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 901/1817] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:20.125532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.126319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] MFA Rules not processed for user `f83352aa0c3843e09f2a666b753a7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:20.127539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.172050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c2d9-78f7-4b7c-9613-374813aba524 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.192729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:20.199003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268ff4-6b87-47c4-8ad6-6590c21e7ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.199681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268ff4-6b87-47c4-8ad6-6590c21e7ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.200369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268ff4-6b87-47c4-8ad6-6590c21e7ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.201085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268ff4-6b87-47c4-8ad6-6590c21e7ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.202481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268ff4-6b87-47c4-8ad6-6590c21e7ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.206158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268ff4-6b87-47c4-8ad6-6590c21e7ee3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.257626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 902/1818] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:20.259616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.262382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.262576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.266066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 917/1819] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Aug 31 00:19:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:20.266881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.282318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bedce4-2f3f-41c5-bf73-82157ca1dd89 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.284790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.285463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.285754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.286126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] PATH_INFO: `/v3/projects/54fdd9e788bc4e49b0ab4156b08b7c07/users/a1fe9131103f4b5f9916ee673aefd953/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.312384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fdd9e788bc4e49b0ab4156b08b7c07, user_id=a1fe9131103f4b5f9916ee673aefd953, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.312384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.338671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 918/1820] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:20 2022] PUT /identity/v3/projects/54fdd9e788bc4e49b0ab4156b08b7c07/users/a1fe9131103f4b5f9916ee673aefd953/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:20.339969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.343017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:20.344348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.412904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef9e64-f589-4178-98a8-02ba8d9480bd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.414241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 903/1821] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:19:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:20.420119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342bb8-cb32-4ff4-b853-7eba767842da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.422258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342bb8-cb32-4ff4-b853-7eba767842da admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.422555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342bb8-cb32-4ff4-b853-7eba767842da admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.423435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342bb8-cb32-4ff4-b853-7eba767842da admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.423948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342bb8-cb32-4ff4-b853-7eba767842da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.426173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342bb8-cb32-4ff4-b853-7eba767842da admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.439119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 919/1822] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:20.444066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.467588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b543966-d106-4a9c-b498-0b99fdf5e089 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.472184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.472848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.473131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.473418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] PATH_INFO: `/v3/projects/54fdd9e788bc4e49b0ab4156b08b7c07/users/a1fe9131103f4b5f9916ee673aefd953/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.475788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fdd9e788bc4e49b0ab4156b08b7c07, user_id=a1fe9131103f4b5f9916ee673aefd953, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.479353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.492367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 904/1823] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:20 2022] PUT /identity/v3/projects/54fdd9e788bc4e49b0ab4156b08b7c07/users/a1fe9131103f4b5f9916ee673aefd953/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:20.503807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.504092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.504442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.513304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.515951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.540553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] MFA Rules not processed for user `a1fe9131103f4b5f9916ee673aefd953`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:20.542088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.631235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:20.639203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 920/1824] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:20.644324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1218e4-0db6-4534-bee9-590f7604bf51 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.650029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.650539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:20.650729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.651018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.651296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.652178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:20.688178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:20.719465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.721273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.730696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af398ad-46c6-4c3e-9c3c-1a3b52173f54 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:20.733633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 905/1825] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:19:20.741589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff9f9-5e4a-4dae-a648-b95e0c7578f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:20.742358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff9f9-5e4a-4dae-a648-b95e0c7578f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:20.742635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff9f9-5e4a-4dae-a648-b95e0c7578f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:20.742918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff9f9-5e4a-4dae-a648-b95e0c7578f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:20.753670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff9f9-5e4a-4dae-a648-b95e0c7578f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:20.756020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff9f9-5e4a-4dae-a648-b95e0c7578f6 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:20.766635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 921/1826] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:20.986745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:21.086720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30459e-0f33-487d-adb2-5152300b6d86 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:21.091347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:21.091967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.092242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.092580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] PATH_INFO: `/v3/users/39ed6ffe7ded451dbccc7ee5ea9f7c77` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.093622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ed6ffe7ded451dbccc7ee5ea9f7c77)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:21.095758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:21.152580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ed6ffe7ded451dbccc7ee5ea9f7c77'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.153229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ed6ffe7ded451dbccc7ee5ea9f7c77'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.153830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ed6ffe7ded451dbccc7ee5ea9f7c77'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.167379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ed6ffe7ded451dbccc7ee5ea9f7c77'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.174851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ed6ffe7ded451dbccc7ee5ea9f7c77'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.187408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 906/1827] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:20 2022] DELETE /identity/v3/users/39ed6ffe7ded451dbccc7ee5ea9f7c77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:21.191805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.192278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.192366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.211667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:21.212852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:21.276480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 922/1828] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:21.288172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:21.289558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:21.307871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:21.352391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107b65-0bcb-4e15-b1c5-fe2f5be4ff72 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:21.358178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:21.361989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.361989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.361989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.371127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:21.372581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:21.382015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 907/1829] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:21.644278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:21.645777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:21.661633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fb52-d4a0-43f8-8fab-e8c25056205e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:21.666670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:21.667212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.667524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.667738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] PATH_INFO: `/v3/projects/04dcd6c57dcd4fa7b98c729636eb6c69` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.678930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04dcd6c57dcd4fa7b98c729636eb6c69)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:21.680882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:21.727203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04dcd6c57dcd4fa7b98c729636eb6c69', 'request_id': 'req-047d699e-355b-4e21-866a-07e5ecb71e7f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.733217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04dcd6c57dcd4fa7b98c729636eb6c69', 'request_id': 'req-047d699e-355b-4e21-866a-07e5ecb71e7f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.738677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04dcd6c57dcd4fa7b98c729636eb6c69', 'request_id': 'req-047d699e-355b-4e21-866a-07e5ecb71e7f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.751163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] The token cache is being invalidate because project 04dcd6c57dcd4fa7b98c729636eb6c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:21.751450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.752070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.753551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 923/1830] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:21 2022] DELETE /identity/v3/projects/04dcd6c57dcd4fa7b98c729636eb6c69 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:21.757677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:21.767144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8518c-f8c8-4176-a04b-bebf91df00b1 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:21.822116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:21.822770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.823126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.823449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] PATH_INFO: `/v3/users/a1fe9131103f4b5f9916ee673aefd953` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.824694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fe9131103f4b5f9916ee673aefd953)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:21.826657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:21.872783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fe9131103f4b5f9916ee673aefd953'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.873439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fe9131103f4b5f9916ee673aefd953'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.874120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fe9131103f4b5f9916ee673aefd953'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.885600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fe9131103f4b5f9916ee673aefd953'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.892745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-bac869ce-c055-4a81-a244-39d51cc209b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fe9131103f4b5f9916ee673aefd953'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:21.905431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 908/1831] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:21 2022] DELETE /identity/v3/users/a1fe9131103f4b5f9916ee673aefd953 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:22.192755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.194589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:22.209903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d699e-355b-4e21-866a-07e5ecb71e7f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.263529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:22.276224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.276864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.277142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.277415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] PATH_INFO: `/v3/projects/54fdd9e788bc4e49b0ab4156b08b7c07` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.278537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fdd9e788bc4e49b0ab4156b08b7c07)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.280445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.326953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fdd9e788bc4e49b0ab4156b08b7c07', 'request_id': 'req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:22.332944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fdd9e788bc4e49b0ab4156b08b7c07', 'request_id': 'req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:22.339109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fdd9e788bc4e49b0ab4156b08b7c07', 'request_id': 'req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:22.350929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] The token cache is being invalidate because project 54fdd9e788bc4e49b0ab4156b08b7c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:22.351216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:22.351838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-35ffc893-160a-4f0a-aa3f-7aa4b2f5380e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:22.353332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 924/1832] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:22 2022] DELETE /identity/v3/projects/54fdd9e788bc4e49b0ab4156b08b7c07 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:22.358129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.358419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.358695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.378574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:22.385641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:22.416625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:22.446552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 909/1833] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:22.455517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.455879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.456237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.479808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:22.481011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:22.488864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 925/1834] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:22.493125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.502898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1fbf8-c6b4-400a-bab3-295dd8588b56 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.507912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.508502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.508776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.509044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.509691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:22.510021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.511634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.523522 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 910/1835] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:22.527776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.536935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5d2a9-a18b-4fbb-8e38-96e5ec07cd06 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.541412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.542044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.542323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.542592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.543221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.545105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.571213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 926/1836] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:22 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:22.575251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.585597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771b2d-5dbd-482a-8610-26b4205d6a85 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.641152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.641791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.642141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.642414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.643053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.645020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.666425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 911/1837] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:22 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:22.670428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.681238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c5d0-2aaa-4828-9e29-95bcfe62552f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.685800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.686426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.686702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.686973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.687606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.689246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.700564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 927/1838] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:22.704610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.714368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8508-8ca4-4f68-817f-603a95243757 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.719050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ead60c-2183-4138-9385-4645d5bcf232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.719628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead60c-2183-4138-9385-4645d5bcf232 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.720040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead60c-2183-4138-9385-4645d5bcf232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.720271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead60c-2183-4138-9385-4645d5bcf232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.720816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ead60c-2183-4138-9385-4645d5bcf232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.722449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ead60c-2183-4138-9385-4645d5bcf232 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.732966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 912/1839] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:22.737069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.747506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81597a-8f8c-42d5-828e-d1034d021e56 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.752060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.752733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.753010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.753283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] PATH_INFO: `/v3/projects/120c6f98595245f0858aa2b6b5e46b30/users/1897a0ad673d47a58c66854c7ef7edfc/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.767975 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120c6f98595245f0858aa2b6b5e46b30, user_id=1897a0ad673d47a58c66854c7ef7edfc, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.770665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.783357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 928/1840] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:22 2022] PUT /identity/v3/projects/120c6f98595245f0858aa2b6b5e46b30/users/1897a0ad673d47a58c66854c7ef7edfc/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:22.793369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.793868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.793990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.821984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] MFA Rules not processed for user `1897a0ad673d47a58c66854c7ef7edfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:22.823186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:22.901896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 913/1841] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:22.906771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.990898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ed3e3-5100-4606-aaa4-ab3cf90150d0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.996183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.996787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.997044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.997315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.006316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.006316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.037233 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 929/1842] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:22 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:23.041260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.053436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d620b-2c04-446f-9eda-395fa2ef7b75 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.133451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.172158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.172836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.173118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.173407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.174352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.176422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.202221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 914/1843] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:23 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:23.203965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.215955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.231111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a6f9-4a77-4d31-a92d-d63b7b243529 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.254442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.255112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.255348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.255678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.258167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.261299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.285917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 930/1844] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:23.292475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.315354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a5f1-7a02-4443-a117-f6a7c81fbf8d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.332739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297a70-c306-447f-b4ad-2e75ba080066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.333369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297a70-c306-447f-b4ad-2e75ba080066 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.333864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297a70-c306-447f-b4ad-2e75ba080066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.334155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297a70-c306-447f-b4ad-2e75ba080066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.334811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297a70-c306-447f-b4ad-2e75ba080066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.336624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297a70-c306-447f-b4ad-2e75ba080066 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.360059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 915/1845] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:23.365896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.378553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2340ab-d258-4353-b598-05b09aeab238 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.396710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.399071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.399550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.400003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] PATH_INFO: `/v3/projects/f2694feed9074ad59fdebbe2ed703056/users/88d1e232ef4246579d90e22df5ca6589/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.456048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2694feed9074ad59fdebbe2ed703056, user_id=88d1e232ef4246579d90e22df5ca6589, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.471079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.499641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 931/1846] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:23 2022] PUT /identity/v3/projects/f2694feed9074ad59fdebbe2ed703056/users/88d1e232ef4246579d90e22df5ca6589/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:23.500088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.500422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.500853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.575734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] MFA Rules not processed for user `88d1e232ef4246579d90e22df5ca6589`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:23.577915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:23.694165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 916/1847] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:23.698774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.791255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75742-16ba-41ff-9079-498292aea43a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.810950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.810950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.810950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.810950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.811314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.811314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.848045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 932/1848] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:23 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:23.852182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.871423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da0cdf-0fb1-4815-a8a7-a665226dfcb3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.000179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.001074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.001501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.001789 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.002498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.004509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.030539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 917/1849] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:23 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:24.031999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:24.044952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0a02-791b-46ce-a71a-f215ea4309d6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.050453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.051149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.051585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.051842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.053262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.055771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.068549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 933/1850] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:24.072555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:24.085069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e5db-0487-4bd7-ae4a-5e1c4b945b02 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.094543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.095314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.095659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.096106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] PATH_INFO: `/v3/projects/d86bd72fbdad48aaac44dc4d45af72d6/users/18db215fc7f3495181e8a16ff0f68c25/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.118469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86bd72fbdad48aaac44dc4d45af72d6, user_id=18db215fc7f3495181e8a16ff0f68c25, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.136967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.156570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 918/1851] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:24 2022] PUT /identity/v3/projects/d86bd72fbdad48aaac44dc4d45af72d6/users/18db215fc7f3495181e8a16ff0f68c25/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:24.162304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:24.171449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ffb2-ac0f-415c-8352-050ef2ee87e5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.249280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cb678-7c35-434a-9d35-b587a66e9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.250067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb678-7c35-434a-9d35-b587a66e9dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.250302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb678-7c35-434a-9d35-b587a66e9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.250570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb678-7c35-434a-9d35-b587a66e9dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.252883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cb678-7c35-434a-9d35-b587a66e9dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.254629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cb678-7c35-434a-9d35-b587a66e9dd3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.266676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 934/1852] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:24.271654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:24.282728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153df5-4147-4a47-8863-863968ba708e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.305421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.306143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.306411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.306680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] PATH_INFO: `/v3/projects/d86bd72fbdad48aaac44dc4d45af72d6/users/18db215fc7f3495181e8a16ff0f68c25/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.314442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86bd72fbdad48aaac44dc4d45af72d6, user_id=18db215fc7f3495181e8a16ff0f68c25, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.322895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.325899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:24.354894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 919/1853] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:24 2022] PUT /identity/v3/projects/d86bd72fbdad48aaac44dc4d45af72d6/users/18db215fc7f3495181e8a16ff0f68c25/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:24.365311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b729f-516e-42d2-811f-21260341559e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.365677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b729f-516e-42d2-811f-21260341559e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.366148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b729f-516e-42d2-811f-21260341559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.409063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-073b729f-516e-42d2-811f-21260341559e None None] MFA Rules not processed for user `18db215fc7f3495181e8a16ff0f68c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:24.410816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-073b729f-516e-42d2-811f-21260341559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:24.460619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:24.584805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 935/1854] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:24.669544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:24.671396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:24.814523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ef8a-8c96-489e-a6c7-45b8f6c9b85f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.824925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.826389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.826819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.827436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.913026 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.914737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.941447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 920/1855] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:26.745649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b729f-516e-42d2-811f-21260341559e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:26.758438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b729f-516e-42d2-811f-21260341559e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:26.767443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add04dec-d347-463e-a1eb-498f10c8360a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:26.768584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04dec-d347-463e-a1eb-498f10c8360a service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.770425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04dec-d347-463e-a1eb-498f10c8360a service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.770705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add04dec-d347-463e-a1eb-498f10c8360a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:26.821440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:26.832452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:26.838211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add04dec-d347-463e-a1eb-498f10c8360a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:26.840045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add04dec-d347-463e-a1eb-498f10c8360a service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:26.853469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 936/1856] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:26.967152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbad5b-918b-4d50-9c7e-af2ce6be4fdf service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:26.985964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:26.986816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.987192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.989195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] PATH_INFO: `/v3/users/b2062a5b0735481cbf6ba3277ca4f2ce` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.000112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2062a5b0735481cbf6ba3277ca4f2ce)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.004814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.092683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2062a5b0735481cbf6ba3277ca4f2ce'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.093732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2062a5b0735481cbf6ba3277ca4f2ce'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.094537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2062a5b0735481cbf6ba3277ca4f2ce'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.096505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:27.109158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2062a5b0735481cbf6ba3277ca4f2ce'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.116510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2062a5b0735481cbf6ba3277ca4f2ce'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.129245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 921/1857] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:26 2022] DELETE /identity/v3/users/b2062a5b0735481cbf6ba3277ca4f2ce => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:27.134622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.135131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.135413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.161219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:27.163184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:27.242801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 937/1858] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:27.252843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.254481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:27.324211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d654a-9e44-4898-9c6b-e90adce3db4e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.327845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.328451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.328727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.328999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.342728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.344484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.355754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 922/1859] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:27.660868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.663309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:27.695346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab8cc0-3822-414c-bb97-cd8c2de55177 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.700024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.700640 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.700953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.701229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] PATH_INFO: `/v3/projects/184297559bbd46769747a536e4a0172c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.702377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184297559bbd46769747a536e4a0172c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.704316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.760221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184297559bbd46769747a536e4a0172c', 'request_id': 'req-3684a8d8-4eaf-4266-bb2a-438e85cbe443'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.767169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184297559bbd46769747a536e4a0172c', 'request_id': 'req-3684a8d8-4eaf-4266-bb2a-438e85cbe443'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.772548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:27.775110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184297559bbd46769747a536e4a0172c', 'request_id': 'req-3684a8d8-4eaf-4266-bb2a-438e85cbe443'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.803744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] The token cache is being invalidate because project 184297559bbd46769747a536e4a0172c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:27.804115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.804906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.806815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 938/1860] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:27 2022] DELETE /identity/v3/projects/184297559bbd46769747a536e4a0172c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:27.810777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.821865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb0840-fbfe-4172-8e5c-22276d694b95 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.893742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.894477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.894761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.895027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] PATH_INFO: `/v3/users/acd40b889adb4a9693e694819e49bbbd` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.896875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd40b889adb4a9693e694819e49bbbd)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.898999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.959796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd40b889adb4a9693e694819e49bbbd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.960703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd40b889adb4a9693e694819e49bbbd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.961342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd40b889adb4a9693e694819e49bbbd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.975242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd40b889adb4a9693e694819e49bbbd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.983225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a663506-9422-42b9-a05f-6fbd5370f818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd40b889adb4a9693e694819e49bbbd'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:27.986291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:28.004653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 923/1861] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:27 2022] DELETE /identity/v3/users/acd40b889adb4a9693e694819e49bbbd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:28.381696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.383255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:28.403925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684a8d8-4eaf-4266-bb2a-438e85cbe443 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.481089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.481744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.482057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.482338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] PATH_INFO: `/v3/projects/5bd28df16e9741aab61d53ff89c1ce7b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.483494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd28df16e9741aab61d53ff89c1ce7b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.485420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.541584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd28df16e9741aab61d53ff89c1ce7b', 'request_id': 'req-2ad15f2e-706f-43ea-8898-431331a28867'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:28.551313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd28df16e9741aab61d53ff89c1ce7b', 'request_id': 'req-2ad15f2e-706f-43ea-8898-431331a28867'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:28.565613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd28df16e9741aab61d53ff89c1ce7b', 'request_id': 'req-2ad15f2e-706f-43ea-8898-431331a28867'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:28.581727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] The token cache is being invalidate because project 5bd28df16e9741aab61d53ff89c1ce7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:28.582125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:28.582787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2ad15f2e-706f-43ea-8898-431331a28867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:28.585009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 939/1862] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:28 2022] DELETE /identity/v3/projects/5bd28df16e9741aab61d53ff89c1ce7b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:28.590004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.590475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.590805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.612989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:28.614403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:28.697117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 924/1863] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:28.705516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.705804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.706124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.727152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:28.728647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:28.736998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 940/1864] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:28.741852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.752790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4de7-a06c-404b-b510-75a626efa41c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.757723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.758378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.758656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.758928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.759642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:28.759950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.761566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.779356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 925/1865] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:28.780572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.792484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6101266-77b3-4c6a-af7c-f039bc733b40 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.798153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.799303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.799603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.799872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.800570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.802672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.832695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 941/1866] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:28 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:28.837639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.848048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c365151-33ee-470c-8c51-1c176fd6a8f4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.911903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.912520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.913105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.913376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.914041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.915992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.947045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 926/1867] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:28 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:28.948555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.961190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcecedc-fab7-4de7-b4a7-74fd4838179b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.966166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.966770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.967051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.967331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.967984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.969620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.984722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 942/1868] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:28.985384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.003213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346f66f-5a61-40c5-b735-c9c420d2f658 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.007958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50715d-f744-4ba0-9009-e6e49c4408ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.008559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50715d-f744-4ba0-9009-e6e49c4408ce admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.008839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50715d-f744-4ba0-9009-e6e49c4408ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.009108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50715d-f744-4ba0-9009-e6e49c4408ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.009752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50715d-f744-4ba0-9009-e6e49c4408ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.011369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50715d-f744-4ba0-9009-e6e49c4408ce admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.023355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 927/1869] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:29.027557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.038182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e1b83-c691-4a29-abce-b30422f3a79a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.042799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.043378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.043658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.043932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] PATH_INFO: `/v3/projects/a4e331d979c04d1389bb316fbdbdf9b8/users/5a15f479ae4c4c18bc46634fc81da74d/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.058999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e331d979c04d1389bb316fbdbdf9b8, user_id=5a15f479ae4c4c18bc46634fc81da74d, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.061869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.076524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 943/1870] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:29 2022] PUT /identity/v3/projects/a4e331d979c04d1389bb316fbdbdf9b8/users/5a15f479ae4c4c18bc46634fc81da74d/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:29.087028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.087543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.087981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.121597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] MFA Rules not processed for user `5a15f479ae4c4c18bc46634fc81da74d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:29.122711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:29.175097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:29.205168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 928/1871] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:29.210070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.228442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:29.292217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4354a-3271-4335-b5a7-73ae6277928b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.297048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.297645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.298228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.298401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.299320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.301308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.331992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 944/1872] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:29 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:29.339149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.351434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821077c0-90d4-4239-86d6-43003ab9b221 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.411172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.412465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.412770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.413061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.413738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.416045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.457264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 929/1873] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:29 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:29.461533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.479530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e897e-b764-477b-9940-effe14b7f845 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.486180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.486912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.487072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.487347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.487992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.489661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.514371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 945/1874] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:29.522640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.533436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1bcc0-8de1-4110-9d4c-fd6edac79780 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.538426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67057874-6052-4c0b-a629-7b3bd0f59db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.540064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67057874-6052-4c0b-a629-7b3bd0f59db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.540335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67057874-6052-4c0b-a629-7b3bd0f59db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.540758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67057874-6052-4c0b-a629-7b3bd0f59db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.541629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67057874-6052-4c0b-a629-7b3bd0f59db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.543397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67057874-6052-4c0b-a629-7b3bd0f59db1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.575853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 930/1875] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:29.581305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.593041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8a4d9-d9b1-476f-adc2-75a5dc02d310 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.600118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.600807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.601085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.601358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] PATH_INFO: `/v3/projects/5c1038101e674157bea1e2157a918ed3/users/70a7cc2fcd114c629d48ae8a5daf54d7/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.631211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1038101e674157bea1e2157a918ed3, user_id=70a7cc2fcd114c629d48ae8a5daf54d7, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.633928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.648303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 946/1876] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:29 2022] PUT /identity/v3/projects/5c1038101e674157bea1e2157a918ed3/users/70a7cc2fcd114c629d48ae8a5daf54d7/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:29.659471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.659844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.660191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.709276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] MFA Rules not processed for user `70a7cc2fcd114c629d48ae8a5daf54d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:29.710657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:29.778316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.780681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:29.811933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 931/1877] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:29.819481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:29.898454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:29.905000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec08de-c075-4274-a41a-919b8e16dc6f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.913215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44188dfa-81ce-43cb-8487-a3c2c7282def None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:29.915907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.916527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.916864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.917138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.921199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:29.921815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:29.923271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:29.925237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:29.925583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:29.926779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:29.930179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:29.971527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 932/1878] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:29 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:29.973679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.062902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91f02-b0ea-4010-8c23-3fe468359fd1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.067280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.070309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.070685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.071373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.071739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.072084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.072918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.075401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.109351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 933/1880] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:29 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:30.109929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 947/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:30.110330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.140200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cb4d-0c90-4df3-a20f-582760964252 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.157122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.157764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.158127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.158351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.165176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.166858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.182971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 934/1881] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:30.186879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.212024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb489-a32a-4ca2-b1f2-00d67a98d7c3 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.217659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.218540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.218824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.219097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] PATH_INFO: `/v3/projects/7c685af2148c4190a6cf7f0403ea19f6/users/630795e074714bc48073c217e44a8a30/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.243408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:30.256595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c685af2148c4190a6cf7f0403ea19f6, user_id=630795e074714bc48073c217e44a8a30, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.263543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.291728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 948/1882] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:30 2022] PUT /identity/v3/projects/7c685af2148c4190a6cf7f0403ea19f6/users/630795e074714bc48073c217e44a8a30/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:30.295809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.311633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae565c3-5862-45a5-b958-a8e6b3320675 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.428365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63a9df-13f8-41a2-8222-9fc05da6b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.428993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63a9df-13f8-41a2-8222-9fc05da6b05c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.429438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63a9df-13f8-41a2-8222-9fc05da6b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.429892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63a9df-13f8-41a2-8222-9fc05da6b05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.430555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63a9df-13f8-41a2-8222-9fc05da6b05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.432294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63a9df-13f8-41a2-8222-9fc05da6b05c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.456261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 935/1883] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:30.465343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.482798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844520f-e1a8-4087-a215-db090890f168 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.506237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.507141 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.507634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.507917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] PATH_INFO: `/v3/projects/7c685af2148c4190a6cf7f0403ea19f6/users/630795e074714bc48073c217e44a8a30/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.513002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c685af2148c4190a6cf7f0403ea19f6, user_id=630795e074714bc48073c217e44a8a30, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.516937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.530005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 949/1884] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:30 2022] PUT /identity/v3/projects/7c685af2148c4190a6cf7f0403ea19f6/users/630795e074714bc48073c217e44a8a30/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:30.541310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.541610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.541903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.577598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] MFA Rules not processed for user `630795e074714bc48073c217e44a8a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:30.579037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:30.635031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:30.664887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 936/1885] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:30.676654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.678626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:30.746319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b39e0-4887-4216-b1ff-d6263a2347b2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.750319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.750965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.751239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.751520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.761749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.763224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.778620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 950/1886] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:30.824407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:30.834856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eebe6-1d3b-4e97-bcf7-38bd1b60b4d1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:30.838561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c2aa-e074-4cf2-a86c-7739d5275bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:30.839158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c2aa-e074-4cf2-a86c-7739d5275bea service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.839434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c2aa-e074-4cf2-a86c-7739d5275bea service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.839704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c2aa-e074-4cf2-a86c-7739d5275bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.904985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c2aa-e074-4cf2-a86c-7739d5275bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:30.906478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c2aa-e074-4cf2-a86c-7739d5275bea service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:30.916408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 937/1887] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:31.128961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:31.132264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:31.261370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a43644-95f4-400d-91ea-fd2998260c63 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:31.269638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:31.270327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:31.270751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:31.271009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:31.275396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:31.299055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:31.300515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae3422-06c0-41a5-9a5f-10684137a8b1 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:31.322357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 951/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:32.507351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2e54d-052b-4691-bb10-3c3ed5903b18 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.508635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2e54d-052b-4691-bb10-3c3ed5903b18 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.509295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2e54d-052b-4691-bb10-3c3ed5903b18 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.511154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 938/1889] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:19:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:32.587785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.588339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.588547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.645009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:32.650062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:32.906369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 952/1890] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:19:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:33.073010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2e54d-052b-4691-bb10-3c3ed5903b18 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:33.075213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70d2e54d-052b-4691-bb10-3c3ed5903b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:33.109612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2e54d-052b-4691-bb10-3c3ed5903b18 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:33.115085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:33.115699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:33.116043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:33.116380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:33.129062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:33.132203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:33.199423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 939/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:34.326956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:34.327554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:34.342853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:34.343351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:34.426828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206677ee-cd38-49d5-9af5-0e914c81f50e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:34.441590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:34.442867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:34.443420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:34.444092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] PATH_INFO: `/v3/users/5a15f479ae4c4c18bc46634fc81da74d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:34.445948 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a15f479ae4c4c18bc46634fc81da74d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:34.448207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:34.455383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178a1e7-8572-4632-9c3a-c692f2a0ca3f service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:34.468179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:34.469383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:34.470005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:34.471269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] PATH_INFO: `/v3/users/9676c9d1846341b5ac7435c2b9535978` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:34.474828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9676c9d1846341b5ac7435c2b9535978)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:34.478492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:34.546380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a15f479ae4c4c18bc46634fc81da74d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.557690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9676c9d1846341b5ac7435c2b9535978'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.558724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9676c9d1846341b5ac7435c2b9535978'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.559582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9676c9d1846341b5ac7435c2b9535978'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.561400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a15f479ae4c4c18bc46634fc81da74d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.583468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a15f479ae4c4c18bc46634fc81da74d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.584309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a15f479ae4c4c18bc46634fc81da74d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.593586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-12537597-8202-4211-8a0a-c1b3892aade0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a15f479ae4c4c18bc46634fc81da74d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.601714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9676c9d1846341b5ac7435c2b9535978'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.606996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:34.607949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 953/1892] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:34 2022] DELETE /identity/v3/users/5a15f479ae4c4c18bc46634fc81da74d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:34.610321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:34.624599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:34.624901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:34.625348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7cb79846-a37c-4386-bee2-77ad325cb684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9676c9d1846341b5ac7435c2b9535978'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.656480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 940/1893] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:34 2022] DELETE /identity/v3/users/9676c9d1846341b5ac7435c2b9535978 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:34.665240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:34.665617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:34.666022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:34.672416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:34.676127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:34.714495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:34.718081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:34.786124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 954/1894] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:34.786124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:34.790642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:34.813324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc30a1-beb5-4fe8-aeab-626cc39d6d4b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:34.823385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 941/1895] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:34.824362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:34.830314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:34.833760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:34.834812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:34.835241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:34.835734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] PATH_INFO: `/v3/users/1897a0ad673d47a58c66854c7ef7edfc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:34.838536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1897a0ad673d47a58c66854c7ef7edfc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:34.844068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:34.922277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:34.932416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5968-40a8-48f0-85ac-0b65f19fcb1d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:34.945557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:34.946414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:34.949486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:34.949923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:34.950427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1897a0ad673d47a58c66854c7ef7edfc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.964354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1897a0ad673d47a58c66854c7ef7edfc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.976366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:34.978372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:34.988511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1897a0ad673d47a58c66854c7ef7edfc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.988785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1897a0ad673d47a58c66854c7ef7edfc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:34.991453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 942/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:34.992956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:34.994561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:35.006130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef186731-6fc4-42ef-9623-3077162d5bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1897a0ad673d47a58c66854c7ef7edfc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:35.028296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2b24-eeed-4b41-934f-a64f08e81279 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:35.034071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:35.034715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:35.035001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:35.035277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:35.039037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:35.045333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 955/1897] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:34 2022] DELETE /identity/v3/users/1897a0ad673d47a58c66854c7ef7edfc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:35.047334 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576758d4-03b1-4d80-8e57-2e6ef8bb3d91 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:35.047835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576758d4-03b1-4d80-8e57-2e6ef8bb3d91 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:35.048313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576758d4-03b1-4d80-8e57-2e6ef8bb3d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:35.075759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:35.083507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:35.092349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-576758d4-03b1-4d80-8e57-2e6ef8bb3d91 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:35.093990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-576758d4-03b1-4d80-8e57-2e6ef8bb3d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:35.114851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 943/1898] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:35.197759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 956/1899] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:35.225397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:35.226958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:35.245194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a355f-0d10-4753-a04e-cdc8cf17e8f4 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:35.372969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514b55-f6db-4e04-aeb8-de8d37cb40aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:35.373673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514b55-f6db-4e04-aeb8-de8d37cb40aa service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:35.374005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514b55-f6db-4e04-aeb8-de8d37cb40aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:35.374327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514b55-f6db-4e04-aeb8-de8d37cb40aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:35.413503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b514b55-f6db-4e04-aeb8-de8d37cb40aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:35.421564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b514b55-f6db-4e04-aeb8-de8d37cb40aa service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:35.452531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 944/1900] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:36.172150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a548-d87f-42e5-ab57-62a17a7911dc None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.172745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a548-d87f-42e5-ab57-62a17a7911dc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.172745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a548-d87f-42e5-ab57-62a17a7911dc None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.174455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 957/1901] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:36.185968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.187000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.187499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.233071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:36.235772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.256661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.366024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 945/1902] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:19:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:36.473891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a548-d87f-42e5-ab57-62a17a7911dc None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.475835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8c78a548-d87f-42e5-ab57-62a17a7911dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.497716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a548-d87f-42e5-ab57-62a17a7911dc None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.507755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.508386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.508671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.508945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.519263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.521226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.533247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 958/1903] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:36.572048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.573644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.591755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dbfe0-9b7e-4fb0-87a6-db764f370100 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.600305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.601355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.610702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.613699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] PATH_INFO: `/v3/projects/d57d3ecb7d4f4b819e1f5c8669d84d22` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.617142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57d3ecb7d4f4b819e1f5c8669d84d22)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.620936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.779119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57d3ecb7d4f4b819e1f5c8669d84d22', 'request_id': 'req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:36.787083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57d3ecb7d4f4b819e1f5c8669d84d22', 'request_id': 'req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:36.797258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57d3ecb7d4f4b819e1f5c8669d84d22', 'request_id': 'req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:36.815144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.817320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.835354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] The token cache is being invalidate because project d57d3ecb7d4f4b819e1f5c8669d84d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:36.836366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:36.837244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:36.842620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 946/1904] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:36 2022] DELETE /identity/v3/projects/d57d3ecb7d4f4b819e1f5c8669d84d22 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:36.846740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.849444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:36.874275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2023cc-01e9-4e44-a9c4-40ba53a6c24c service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.039382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28848d-c533-42ad-9ec1-4d5a73e24c2a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.050860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.052975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.055027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.056227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] PATH_INFO: `/v3/users/5ac6f0545c0048e09774c9b7ef298070` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.061330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac6f0545c0048e09774c9b7ef298070)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.069390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.073701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.075554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.076348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.078526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] PATH_INFO: `/v3/projects/a4e331d979c04d1389bb316fbdbdf9b8` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.080306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e331d979c04d1389bb316fbdbdf9b8)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.084202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.203850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:37.208838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:37.237193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e331d979c04d1389bb316fbdbdf9b8', 'request_id': 'req-de1bda0a-1a12-4df9-96a5-187f1ede143f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.252846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac6f0545c0048e09774c9b7ef298070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.254071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e331d979c04d1389bb316fbdbdf9b8', 'request_id': 'req-de1bda0a-1a12-4df9-96a5-187f1ede143f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.256487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac6f0545c0048e09774c9b7ef298070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.259337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac6f0545c0048e09774c9b7ef298070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.270919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e331d979c04d1389bb316fbdbdf9b8', 'request_id': 'req-de1bda0a-1a12-4df9-96a5-187f1ede143f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.285813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac6f0545c0048e09774c9b7ef298070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.298945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac6f0545c0048e09774c9b7ef298070'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.302217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] The token cache is being invalidate because project a4e331d979c04d1389bb316fbdbdf9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:37.302661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.303980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.307541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 959/1905] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:36 2022] DELETE /identity/v3/projects/a4e331d979c04d1389bb316fbdbdf9b8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:37.312029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.316074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:37.320549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 947/1906] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:36 2022] DELETE /identity/v3/users/5ac6f0545c0048e09774c9b7ef298070 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:37.405912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bda0a-1a12-4df9-96a5-187f1ede143f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.449541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.451042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:37.528294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.535623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.536607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.536973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] PATH_INFO: `/v3/users/70a7cc2fcd114c629d48ae8a5daf54d7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.539048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a7cc2fcd114c629d48ae8a5daf54d7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.541119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.607895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79906b-b890-4b21-824d-7174a5669405 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.620003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.621397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.621524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a7cc2fcd114c629d48ae8a5daf54d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.622074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.623127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] PATH_INFO: `/v3/projects/120c6f98595245f0858aa2b6b5e46b30` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.624614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120c6f98595245f0858aa2b6b5e46b30)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.628298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.632444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a7cc2fcd114c629d48ae8a5daf54d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.650174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a7cc2fcd114c629d48ae8a5daf54d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.650931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a7cc2fcd114c629d48ae8a5daf54d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.652584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:37.681265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a7cc2fcd114c629d48ae8a5daf54d7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.689896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 960/1907] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:37 2022] DELETE /identity/v3/users/70a7cc2fcd114c629d48ae8a5daf54d7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:37.718408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120c6f98595245f0858aa2b6b5e46b30', 'request_id': 'req-316909a0-ffcc-41af-82a5-b6a685a4ad84'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.728495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120c6f98595245f0858aa2b6b5e46b30', 'request_id': 'req-316909a0-ffcc-41af-82a5-b6a685a4ad84'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.736448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120c6f98595245f0858aa2b6b5e46b30', 'request_id': 'req-316909a0-ffcc-41af-82a5-b6a685a4ad84'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.763734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] The token cache is being invalidate because project 120c6f98595245f0858aa2b6b5e46b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:37.764193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.764896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:37.766715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 948/1908] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:37 2022] DELETE /identity/v3/projects/120c6f98595245f0858aa2b6b5e46b30 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:37.771271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.772957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:37.913174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec6112-305e-4a1a-a289-1e8c2575aa82 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:38.029007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:38.030019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.030798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.031224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] PATH_INFO: `/v3/users/88d1e232ef4246579d90e22df5ca6589` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.032904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d1e232ef4246579d90e22df5ca6589)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.034965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.171458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d1e232ef4246579d90e22df5ca6589'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.191822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d1e232ef4246579d90e22df5ca6589'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.234062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:38.235661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:38.245538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d1e232ef4246579d90e22df5ca6589'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.249989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d1e232ef4246579d90e22df5ca6589'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.274796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d1e232ef4246579d90e22df5ca6589'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.275030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316909a0-ffcc-41af-82a5-b6a685a4ad84 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:38.282372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:38.283981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.284613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.285034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] PATH_INFO: `/v3/projects/5c1038101e674157bea1e2157a918ed3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.286565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1038101e674157bea1e2157a918ed3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.290245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 961/1909] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:37 2022] DELETE /identity/v3/users/88d1e232ef4246579d90e22df5ca6589 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:38.291866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.459752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:38.491320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1038101e674157bea1e2157a918ed3', 'request_id': 'req-09a29e0c-9419-4522-8795-9e2cc5ed9951'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.506922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1038101e674157bea1e2157a918ed3', 'request_id': 'req-09a29e0c-9419-4522-8795-9e2cc5ed9951'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.514520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1038101e674157bea1e2157a918ed3', 'request_id': 'req-09a29e0c-9419-4522-8795-9e2cc5ed9951'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.540380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] The token cache is being invalidate because project 5c1038101e674157bea1e2157a918ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:38.540895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.541710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-09a29e0c-9419-4522-8795-9e2cc5ed9951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.555490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 949/1910] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:38 2022] DELETE /identity/v3/projects/5c1038101e674157bea1e2157a918ed3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:38.556060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:38.557680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:38.575765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31677-6715-49c5-bbe0-fee258f504ad None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.576449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31677-6715-49c5-bbe0-fee258f504ad None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.577067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31677-6715-49c5-bbe0-fee258f504ad None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.580862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 950/1911] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:19:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:38.588282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.589091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.589899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.607294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:38.644388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:38.645614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:38.743896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23dcbf-c2dd-4361-8640-a898351303d2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:38.822743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 951/1912] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:19:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:38.823626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:38.824807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:38.825276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:38.825694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.826028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.826305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] PATH_INFO: `/v3/users/630795e074714bc48073c217e44a8a30` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.829170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630795e074714bc48073c217e44a8a30)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.831615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.852205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88d1e-4c94-4c98-b49a-4d9494db91c8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:38.870692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:38.871351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.871643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.871916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] PATH_INFO: `/v3/projects/b7722f0924594c98baa1a3637444adc8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.873093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7722f0924594c98baa1a3637444adc8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.875510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.945685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630795e074714bc48073c217e44a8a30'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.975636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630795e074714bc48073c217e44a8a30'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:38.996215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7722f0924594c98baa1a3637444adc8', 'request_id': 'req-db077b82-ed58-4d36-95b2-2122b95c25a5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.003564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7722f0924594c98baa1a3637444adc8', 'request_id': 'req-db077b82-ed58-4d36-95b2-2122b95c25a5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.009560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7722f0924594c98baa1a3637444adc8', 'request_id': 'req-db077b82-ed58-4d36-95b2-2122b95c25a5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.017223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630795e074714bc48073c217e44a8a30'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.018592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630795e074714bc48073c217e44a8a30'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.032195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] The token cache is being invalidate because project b7722f0924594c98baa1a3637444adc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:39.033054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.033552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-75a81b46-724e-4a9b-ae4f-fde969dfc4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630795e074714bc48073c217e44a8a30'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.034374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.038092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 952/1913] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:38 2022] DELETE /identity/v3/projects/b7722f0924594c98baa1a3637444adc8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:39.039137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.042640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:39.049867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 962/1914] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:38 2022] DELETE /identity/v3/users/630795e074714bc48073c217e44a8a30 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:39.049867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae057a6-24f1-464b-8f9f-49403bad3209 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.049867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae057a6-24f1-464b-8f9f-49403bad3209 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.049867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae057a6-24f1-464b-8f9f-49403bad3209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.073353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9ae057a6-24f1-464b-8f9f-49403bad3209 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:39.074735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ae057a6-24f1-464b-8f9f-49403bad3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:39.114876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:39.127168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:39.174294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 963/1915] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:39.175521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.175827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.176090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.191304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db077b82-ed58-4d36-95b2-2122b95c25a5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.215729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:39.217771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:39.242511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 964/1916] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:39.244495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.255261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6931-6e49-49cb-bcb7-c8eed9a23b6d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.268721 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.269622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.270113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.271065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.271935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:39.272584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.275007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.290578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 965/1917] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:39.295482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.307667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421674d2-0015-4d1a-8813-9a61b65d3d8f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.315084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.315892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.316367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.316649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.317323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.319033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.319346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.322616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.322903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.323462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.326658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:39.359035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.361607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.368943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 966/1918] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:39 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:39.374296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.387796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 953/1919] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:39.459873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ffda-6668-4e7c-8dd8-cf19cb656bfb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.467223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.468675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.468675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.468675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.469384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.471521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.503196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 967/1920] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:39 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:39.507905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.531517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eccf61-cae9-4ddb-820e-9d81c670d8f6 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.547535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.548168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.548714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.548994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.549652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.553304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.569078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 954/1921] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:39.570874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.585327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c4d9-6a98-4e57-bf38-9717e2ebe11c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.593354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.594140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.594523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.595582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.596310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.600297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.606527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.608711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:39.637784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 968/1922] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:39.640356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.641353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818a3d-0f75-43f5-a304-e0a65c363fe1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.663788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.664485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.664742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.665017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] PATH_INFO: `/v3/projects/f2694feed9074ad59fdebbe2ed703056` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.667405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2694feed9074ad59fdebbe2ed703056)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.683736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.685666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c42f46-4535-42bf-9f81-2900c65e1503 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:39.713579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d94801-3240-4f0d-95d7-203fe89a4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:39.715548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94801-3240-4f0d-95d7-203fe89a4dad admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.718369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94801-3240-4f0d-95d7-203fe89a4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.719578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94801-3240-4f0d-95d7-203fe89a4dad admin admin] PATH_INFO: `/v3/projects/def9a9925be44d099a8265db65c8b7e8/users/2a553c2dd07f4854ba42f68a5010ed7c/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.783955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d94801-3240-4f0d-95d7-203fe89a4dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=def9a9925be44d099a8265db65c8b7e8, user_id=2a553c2dd07f4854ba42f68a5010ed7c, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:39.803911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d94801-3240-4f0d-95d7-203fe89a4dad admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:39.840293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 969/1923] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:39 2022] PUT /identity/v3/projects/def9a9925be44d099a8265db65c8b7e8/users/2a553c2dd07f4854ba42f68a5010ed7c/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:39.853221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:39.853491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:39.853773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:39.875665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2694feed9074ad59fdebbe2ed703056', 'request_id': 'req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.902270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2694feed9074ad59fdebbe2ed703056', 'request_id': 'req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.915732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2694feed9074ad59fdebbe2ed703056', 'request_id': 'req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.941470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] The token cache is being invalidate because project f2694feed9074ad59fdebbe2ed703056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:39.941775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.943070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:39.944995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 955/1924] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:39 2022] DELETE /identity/v3/projects/f2694feed9074ad59fdebbe2ed703056 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:39.949154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:39.950763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:39.957100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] MFA Rules not processed for user `2a553c2dd07f4854ba42f68a5010ed7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:39.958371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:40.023321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:40.024356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:40.071318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68de4f-b3c4-4a9e-b374-6cfc140e0301 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.077192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.078055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.078442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.078812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] PATH_INFO: `/v3/users/18db215fc7f3495181e8a16ff0f68c25` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.080412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18db215fc7f3495181e8a16ff0f68c25)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.082387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 970/1925] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:40.083607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.087704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.090256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:40.108232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89ab8d-1141-406c-bdc9-9c33c81d663d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.114247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.115505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.115935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.116412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.117414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.119901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.158399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 971/1926] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:40 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:40.163050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.167968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18db215fc7f3495181e8a16ff0f68c25'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.170464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18db215fc7f3495181e8a16ff0f68c25'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.172211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18db215fc7f3495181e8a16ff0f68c25'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.212591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18db215fc7f3495181e8a16ff0f68c25'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.233020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18db215fc7f3495181e8a16ff0f68c25'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.257507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 956/1927] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:39 2022] DELETE /identity/v3/users/18db215fc7f3495181e8a16ff0f68c25 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:40.329977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd560-2610-46c5-a7d4-c5ee4360ed3a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.467201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.467943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.468285 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.468624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.469373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.472286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.497338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 972/1928] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:40 2022] POST /identity/v3/users => generated 300 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:40.501276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.504135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:40.519116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa989-205a-447c-99a8-beb672bd4334 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.525096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.525667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.526121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.526997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.527768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.529636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.543837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 957/1929] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:40.547998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.558953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07879558-7cd1-4e75-af7a-3ca171372290 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.563455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.564379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.564491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.564684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] PATH_INFO: `/v3/projects/0cdde4da43854d638a15af44fd515f08/users/ef451eba7800412bab04c84a3375ac46/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.583856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdde4da43854d638a15af44fd515f08, user_id=ef451eba7800412bab04c84a3375ac46, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.587657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.609418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 973/1930] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:40 2022] PUT /identity/v3/projects/0cdde4da43854d638a15af44fd515f08/users/ef451eba7800412bab04c84a3375ac46/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:40.614656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.626121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a71968-7e63-4eec-b6d1-b735e73bd895 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.655024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.658189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:40.699726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.700556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.700726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.700949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.701594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.704073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.717900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 958/1931] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:40.721778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.730340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:40.739595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95c3b-6904-430d-9dab-8b4a85494577 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.746633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72951-bc72-4e8e-96f4-06bb687b6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.747571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72951-bc72-4e8e-96f4-06bb687b6f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.748099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72951-bc72-4e8e-96f4-06bb687b6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.748785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72951-bc72-4e8e-96f4-06bb687b6f7a admin admin] PATH_INFO: `/v3/projects/0cdde4da43854d638a15af44fd515f08/users/ef451eba7800412bab04c84a3375ac46/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.750578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72951-bc72-4e8e-96f4-06bb687b6f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdde4da43854d638a15af44fd515f08, user_id=ef451eba7800412bab04c84a3375ac46, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.753616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72951-bc72-4e8e-96f4-06bb687b6f7a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.780204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06624-f70e-4bd4-b4e0-2baac68a5151 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.782254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 959/1932] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:40 2022] PUT /identity/v3/projects/0cdde4da43854d638a15af44fd515f08/users/ef451eba7800412bab04c84a3375ac46/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:40.784067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.784549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.784970 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.822050 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] MFA Rules not processed for user `ef451eba7800412bab04c84a3375ac46`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:40.823994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:40.840721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:40.896917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.897576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.897867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.898250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] PATH_INFO: `/v3/projects/7c685af2148c4190a6cf7f0403ea19f6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.899863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c685af2148c4190a6cf7f0403ea19f6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:40.902004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:40.965209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c685af2148c4190a6cf7f0403ea19f6', 'request_id': 'req-b9209596-1668-4c9d-8748-92bc4ad3905f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.977306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 960/1933] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:40.977662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c685af2148c4190a6cf7f0403ea19f6', 'request_id': 'req-b9209596-1668-4c9d-8748-92bc4ad3905f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.988764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c685af2148c4190a6cf7f0403ea19f6', 'request_id': 'req-b9209596-1668-4c9d-8748-92bc4ad3905f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:40.993594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.995720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.011831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] The token cache is being invalidate because project 7c685af2148c4190a6cf7f0403ea19f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:41.012530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.013335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b9209596-1668-4c9d-8748-92bc4ad3905f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.020889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 974/1934] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:40 2022] DELETE /identity/v3/projects/7c685af2148c4190a6cf7f0403ea19f6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:41.022864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fcc5-8465-45bb-b8e6-54ee0a8b8960 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.023298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fcc5-8465-45bb-b8e6-54ee0a8b8960 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.023859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fcc5-8465-45bb-b8e6-54ee0a8b8960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.054378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f2b1fcc5-8465-45bb-b8e6-54ee0a8b8960 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:41.056045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f2b1fcc5-8465-45bb-b8e6-54ee0a8b8960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.077283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8874e78-bf0d-4998-904b-a9b3032f8701 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.154401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 975/1935] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:41.160568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.162381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.162564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.162726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.162853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.163086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.163194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.165294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.184051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:41.185302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.196811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 976/1936] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:41.197871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.199252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.211772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c0b8f-c0f6-4a6d-8d81-357a4045ceaa None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.217058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.217869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.218245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.218651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] PATH_INFO: `/v3/projects/d86bd72fbdad48aaac44dc4d45af72d6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.219793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86bd72fbdad48aaac44dc4d45af72d6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.221767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.223631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.245183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.246658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.257022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 961/1937] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:41.257837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.268189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbb6f-7880-4c7c-9f62-5db6e9b9c221 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.277005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86bd72fbdad48aaac44dc4d45af72d6', 'request_id': 'req-e3e75116-73be-424c-a059-5d027fbc9b63'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.284415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86bd72fbdad48aaac44dc4d45af72d6', 'request_id': 'req-e3e75116-73be-424c-a059-5d027fbc9b63'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.286115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.296066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86bd72fbdad48aaac44dc4d45af72d6', 'request_id': 'req-e3e75116-73be-424c-a059-5d027fbc9b63'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.313762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] The token cache is being invalidate because project d86bd72fbdad48aaac44dc4d45af72d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:41.314117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.314919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3e75116-73be-424c-a059-5d027fbc9b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.316650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 977/1938] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:41 2022] DELETE /identity/v3/projects/d86bd72fbdad48aaac44dc4d45af72d6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:41.321678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.322001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.322280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.351942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:41.353367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.353502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.354291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.354714 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.355133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.356088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:41.356540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.359991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58c0b-3d0f-499f-a464-653687db9a29 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.364717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 978/1939] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:41.365591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.372489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.387671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc09fa4-27d1-41bf-abb2-0f111c40c013 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.390431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 962/1940] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:41.392826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.393515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.393793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.394092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] PATH_INFO: `/v3/users/2a553c2dd07f4854ba42f68a5010ed7c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.394988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.395823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.395952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a553c2dd07f4854ba42f68a5010ed7c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.396033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.397215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.421256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:41.423209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.435376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 963/1941] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:41.436149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.439774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.455253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0deea2-0cf4-4f1b-9305-165a323f2730 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.459842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.460454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.460726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.461021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.461642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.463612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.467756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a553c2dd07f4854ba42f68a5010ed7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.480372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a553c2dd07f4854ba42f68a5010ed7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.503783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a553c2dd07f4854ba42f68a5010ed7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.506096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a553c2dd07f4854ba42f68a5010ed7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.519033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 964/1942] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:41.521047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.522197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a553c2dd07f4854ba42f68a5010ed7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:41.532152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 979/1943] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:41 2022] DELETE /identity/v3/users/2a553c2dd07f4854ba42f68a5010ed7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:41.536888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.538810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.615439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517573f-e358-4a89-a6b0-e23532d56490 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.626165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.631960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9d80a-aa8f-412a-9165-57eef007e49d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.638517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20c030-f4fd-4f78-9114-1065bd96161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.639166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c030-f4fd-4f78-9114-1065bd96161e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.639474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c030-f4fd-4f78-9114-1065bd96161e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.639744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c030-f4fd-4f78-9114-1065bd96161e admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.640676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20c030-f4fd-4f78-9114-1065bd96161e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.642824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20c030-f4fd-4f78-9114-1065bd96161e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.663707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 980/1944] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:41.667698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.667985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.668265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.677709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.678347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.678657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.679054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.679717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:41.680018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.681719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.687920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:41.689135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.693829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 965/1945] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:41.698123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 981/1946] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:41.698245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.699107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.706012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.711103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f149c2d-6b9f-4e89-baa9-b675fa63f3b2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.716264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.716857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.717138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.717411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.718048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6dfc1-fff5-4a33-91da-de2d1a7972dd None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.718160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.719700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.722594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.723181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.723519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.723791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.724418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.726360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.730004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 966/1947] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:41.732913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.732913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:41.745986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.758490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 982/1948] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:41.759367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.794550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1789bf-61cf-4f6d-b8f9-e6768ef989be admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.823501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613429e-ae3c-43d8-887c-159df1e045fb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.828569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.829296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.829578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.830018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.830669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.832511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.843538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 983/1949] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:41.844586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.859572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.859572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.859572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.859572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.860032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5e65-8712-415d-9e85-2976f07062d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.865283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.865991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.866350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.866709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.867352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.869469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.875022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.876535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.887873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 967/1950] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:41.892955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.901241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 984/1951] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/users => generated 292 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:41.903823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516190-243b-48b4-b67a-c30164502e6b service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.904191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.909398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ff3b-5bd1-4eb3-95f8-41b9855f1fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.909897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ff3b-5bd1-4eb3-95f8-41b9855f1fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.910261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ff3b-5bd1-4eb3-95f8-41b9855f1fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.910608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ff3b-5bd1-4eb3-95f8-41b9855f1fc2 admin admin] PATH_INFO: `/v3/projects/353802c01e094e879206f68c25bcd220/users/5e2a47c1dc8745c29cfef09c0d3b4030/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.917971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421668-d78c-4b7c-a5af-8d8e4b52a03a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.924473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.925664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.926139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.927458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.928315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.929401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ff3b-5bd1-4eb3-95f8-41b9855f1fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353802c01e094e879206f68c25bcd220, user_id=5e2a47c1dc8745c29cfef09c0d3b4030, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.929829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.932118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ff3b-5bd1-4eb3-95f8-41b9855f1fc2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.945738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 985/1952] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:41.951065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.953343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 968/1953] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:41 2022] PUT /identity/v3/projects/353802c01e094e879206f68c25bcd220/users/5e2a47c1dc8745c29cfef09c0d3b4030/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:41.963271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954d00-c6e3-4fa4-a1d2-107e72c4b2dd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.964949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.965349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.965506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.999103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] MFA Rules not processed for user `5e2a47c1dc8745c29cfef09c0d3b4030`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:42.000377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:42.056970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.057620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.059399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.059399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.060032 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.062431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.079513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 986/1954] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:42.081471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.095175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787a518-8e6e-40d6-aefd-0452d6688829 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.104121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa622-6b4d-4da3-bc60-e45f793a2f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.105256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa622-6b4d-4da3-bc60-e45f793a2f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.105256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa622-6b4d-4da3-bc60-e45f793a2f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.105728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa622-6b4d-4da3-bc60-e45f793a2f32 admin admin] PATH_INFO: `/v3/projects/aa022eea54f741e98e808af6e8902b60/users/fa7f1217c4fd402ba3a314a467b23925/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.130213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fa622-6b4d-4da3-bc60-e45f793a2f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa022eea54f741e98e808af6e8902b60, user_id=fa7f1217c4fd402ba3a314a467b23925, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.134552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fa622-6b4d-4da3-bc60-e45f793a2f32 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.138480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:42.160314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 987/1955] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:42 2022] PUT /identity/v3/projects/aa022eea54f741e98e808af6e8902b60/users/fa7f1217c4fd402ba3a314a467b23925/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:42.174603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 969/1956] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:42.175163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.177545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.177681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.178006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.180941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:42.227329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] MFA Rules not processed for user `fa7f1217c4fd402ba3a314a467b23925`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:42.236506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:42.291020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:42.327763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5138c0a-d38b-4531-801f-4dacd6db7583 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.411447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.412210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.412494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.412826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.438709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 988/1957] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:42.438709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.438709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:42.489590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.491085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.500675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 970/1958] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:42.501443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.503363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:42.507605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af358879-00e4-4ad8-812f-0f2429bab97f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.514167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.514797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.515078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.515347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] PATH_INFO: `/v3/projects/def9a9925be44d099a8265db65c8b7e8` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.516592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=def9a9925be44d099a8265db65c8b7e8)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.518618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.523939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5b69-7905-4f78-b2c5-491168cd411e service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.530605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.532030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.532030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.532417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.544235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.545998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.561057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 971/1959] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:42.589944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def9a9925be44d099a8265db65c8b7e8', 'request_id': 'req-792ab11c-d5c4-4ec6-97c5-e523c090f36b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.600744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def9a9925be44d099a8265db65c8b7e8', 'request_id': 'req-792ab11c-d5c4-4ec6-97c5-e523c090f36b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.617764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def9a9925be44d099a8265db65c8b7e8', 'request_id': 'req-792ab11c-d5c4-4ec6-97c5-e523c090f36b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.637002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] The token cache is being invalidate because project def9a9925be44d099a8265db65c8b7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:42.637538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.639529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.641104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 989/1960] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:42 2022] DELETE /identity/v3/projects/def9a9925be44d099a8265db65c8b7e8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:42.645912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.662475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c898cc-82ad-442e-833b-db9db1126c97 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.803101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.804651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.804961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.805238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] PATH_INFO: `/v3/users/ef451eba7800412bab04c84a3375ac46` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.806844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef451eba7800412bab04c84a3375ac46)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.809198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.896235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:42.944308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef451eba7800412bab04c84a3375ac46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.945240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef451eba7800412bab04c84a3375ac46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.946003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef451eba7800412bab04c84a3375ac46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.962483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef451eba7800412bab04c84a3375ac46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.972940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9abe20b4-8183-48f0-969e-14a63db04c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef451eba7800412bab04c84a3375ac46'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:42.995172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 972/1961] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:42 2022] DELETE /identity/v3/users/ef451eba7800412bab04c84a3375ac46 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:43.389641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:43.391179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:43.404336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ab11c-d5c4-4ec6-97c5-e523c090f36b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:43.416994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:43.466694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:43.467361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.467634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.467913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] PATH_INFO: `/v3/projects/0cdde4da43854d638a15af44fd515f08` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.469160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdde4da43854d638a15af44fd515f08)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:43.471094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:43.523183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdde4da43854d638a15af44fd515f08', 'request_id': 'req-4edbc132-d9a8-451b-b6dd-5829750a9af0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:43.536773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdde4da43854d638a15af44fd515f08', 'request_id': 'req-4edbc132-d9a8-451b-b6dd-5829750a9af0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:43.544498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdde4da43854d638a15af44fd515f08', 'request_id': 'req-4edbc132-d9a8-451b-b6dd-5829750a9af0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:43.561418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] The token cache is being invalidate because project 0cdde4da43854d638a15af44fd515f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:43.561933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:43.563404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4edbc132-d9a8-451b-b6dd-5829750a9af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:43.565154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 990/1962] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:43 2022] DELETE /identity/v3/projects/0cdde4da43854d638a15af44fd515f08 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:43.570753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.571256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.572086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.608116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:43.610171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:43.706108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 973/1963] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:43.713952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.713952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.713952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.739745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:43.742169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:43.754016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 991/1964] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:43.757693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:43.767763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ea44b-0b5e-49c1-846c-b5ccea86abdb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:43.773417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:43.773598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.773995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.774328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.775042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:43.775409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:43.777126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:43.789807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 974/1965] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:43.794103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:43.804496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ebca-f8c0-4fbf-8d37-aeb256e1b04b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:43.809914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:43.810647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.810986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.811319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.812023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:43.814505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:43.859567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 992/1966] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:43 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:43.865622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:43.886330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae665261-f5d2-496a-ac86-f138d61fd4b7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:43.967969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:43.968592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:43.969074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:43.969350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:43.971196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:43.971954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.002698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 975/1967] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:43 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:44.007037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.017401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9f0e-929f-42cb-baae-9f3427388a23 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.022335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.023049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.023388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.023940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.024734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.026498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.040498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 993/1968] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:44.044313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.057376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366a4e1-b0d0-4153-8d94-14536e9ce34f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.062173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc4670-a96e-4365-8269-068b4f7040b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.062674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc4670-a96e-4365-8269-068b4f7040b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.062951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc4670-a96e-4365-8269-068b4f7040b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.063219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc4670-a96e-4365-8269-068b4f7040b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.064182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc4670-a96e-4365-8269-068b4f7040b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.065802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc4670-a96e-4365-8269-068b4f7040b3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.077159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 976/1969] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:44.081254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.091990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f310eed-472c-468e-8d9e-f931dc8a405c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.096554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.097204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.097479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.097748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] PATH_INFO: `/v3/projects/02727f540c21402bbb913d989e402797/users/95f996466b6d4528a79230b123cc773a/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.112793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=02727f540c21402bbb913d989e402797, user_id=95f996466b6d4528a79230b123cc773a, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.116064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.129400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 994/1970] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:44 2022] PUT /identity/v3/projects/02727f540c21402bbb913d989e402797/users/95f996466b6d4528a79230b123cc773a/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:44.139392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.139667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.139936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.167472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] MFA Rules not processed for user `95f996466b6d4528a79230b123cc773a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:44.168665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:44.174283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:44.241744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 977/1971] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:44.246363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.315809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:44.341286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f15c60-d6c7-4536-920a-4cc59959a2ee admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.347831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.349115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.349395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.349813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.350513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.352472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.410076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 995/1972] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:44 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:44.415253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.435232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e801c1e-3c33-449c-b138-1ed542a01bcb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.502581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.503300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.503647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.503987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.504732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.506894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.530422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 978/1973] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:44 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:44.534454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.545190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ef6-1260-475d-aa48-6edc81a0641a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.550057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.550654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.550936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.551230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.552166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.553997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.564564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 996/1974] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:19:44.568669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.578704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1291ca-3f8c-4e59-bd42-88d715631ef1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.584297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.584991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.585262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.585530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] PATH_INFO: `/v3/projects/5c385f157a594009b24f0c7ad4e3ee88/users/3a4e235ee3144277b15d039b4f4b9978/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.601702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c385f157a594009b24f0c7ad4e3ee88, user_id=3a4e235ee3144277b15d039b4f4b9978, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.604945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.617647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 979/1975] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:44 2022] PUT /identity/v3/projects/5c385f157a594009b24f0c7ad4e3ee88/users/3a4e235ee3144277b15d039b4f4b9978/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:44.621556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.631357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0977e-5c7f-46ac-be9a-e1b2cc01dbfe admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.686730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fbd52-bb4e-4ca3-bcd3-efc8260930e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.687337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fbd52-bb4e-4ca3-bcd3-efc8260930e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.687617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fbd52-bb4e-4ca3-bcd3-efc8260930e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.687889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fbd52-bb4e-4ca3-bcd3-efc8260930e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.688528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fbd52-bb4e-4ca3-bcd3-efc8260930e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.690165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fbd52-bb4e-4ca3-bcd3-efc8260930e6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.700010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 997/1976] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:44.704163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.714760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848483c-b875-45e0-9ba3-ba7b929a7607 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.719258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.719896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.720173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.720445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] PATH_INFO: `/v3/projects/5c385f157a594009b24f0c7ad4e3ee88/users/3a4e235ee3144277b15d039b4f4b9978/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.722654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c385f157a594009b24f0c7ad4e3ee88, user_id=3a4e235ee3144277b15d039b4f4b9978, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.725363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.735636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 980/1977] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:44 2022] PUT /identity/v3/projects/5c385f157a594009b24f0c7ad4e3ee88/users/3a4e235ee3144277b15d039b4f4b9978/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:44.746798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.747086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.747364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.775956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] MFA Rules not processed for user `3a4e235ee3144277b15d039b4f4b9978`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:44.777170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:44.851743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 998/1978] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:44.862045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:44.864408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:44.927678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b84a9-87b5-4cb6-b825-088125bd9edd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:44.931377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae1b0-c8a0-4f22-a652-15c13ef02fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:44.931975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae1b0-c8a0-4f22-a652-15c13ef02fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.932252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae1b0-c8a0-4f22-a652-15c13ef02fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.932526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae1b0-c8a0-4f22-a652-15c13ef02fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.941436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ae1b0-c8a0-4f22-a652-15c13ef02fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:44.943420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ae1b0-c8a0-4f22-a652-15c13ef02fe1 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:44.952653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 981/1979] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:45.544717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.591200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:45.614469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fba93-2d8c-452d-88a9-61c9dbb24a3a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:45.619455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:45.620170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.620521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.620867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] PATH_INFO: `/v3/users/95f996466b6d4528a79230b123cc773a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.622091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f996466b6d4528a79230b123cc773a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:45.624105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:45.671392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f996466b6d4528a79230b123cc773a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:45.679683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f996466b6d4528a79230b123cc773a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:45.692727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f996466b6d4528a79230b123cc773a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:45.693410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f996466b6d4528a79230b123cc773a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:45.700206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f996466b6d4528a79230b123cc773a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:45.706040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 999/1980] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:45 2022] DELETE /identity/v3/users/95f996466b6d4528a79230b123cc773a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:45.711153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.711439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.711713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.719055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:45.733106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:45.734332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:45.791887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 982/1981] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:45.801767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.803179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:45.859217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f3af2-2fe3-4eca-a1e3-48a4cbe87e90 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:45.862909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:45.863521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.864294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.864619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.873796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:45.875250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:45.885154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1000/1982] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:46.229704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.231284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:46.243828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a04a6-6bc3-4dab-8a3d-b5b45e3ed84e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.248488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.249120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.249401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.249674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] PATH_INFO: `/v3/projects/02727f540c21402bbb913d989e402797` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.250822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02727f540c21402bbb913d989e402797)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.252802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.305040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02727f540c21402bbb913d989e402797', 'request_id': 'req-cabdce0b-7aa8-420b-ad77-f3a037958102'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.311174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02727f540c21402bbb913d989e402797', 'request_id': 'req-cabdce0b-7aa8-420b-ad77-f3a037958102'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.317906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02727f540c21402bbb913d989e402797', 'request_id': 'req-cabdce0b-7aa8-420b-ad77-f3a037958102'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.335703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] The token cache is being invalidate because project 02727f540c21402bbb913d989e402797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:46.335999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.336862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.341614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 983/1983] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:46 2022] DELETE /identity/v3/projects/02727f540c21402bbb913d989e402797 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:46.342905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.357259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473832c-6bf6-4bcc-b24a-a02580ca7e57 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.453028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.453684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.454091 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.454313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] PATH_INFO: `/v3/users/3a4e235ee3144277b15d039b4f4b9978` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.458979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4e235ee3144277b15d039b4f4b9978)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.461987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.463945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.529541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4e235ee3144277b15d039b4f4b9978'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.537958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4e235ee3144277b15d039b4f4b9978'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.550548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4e235ee3144277b15d039b4f4b9978'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.551300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4e235ee3144277b15d039b4f4b9978'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.558626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-04e6f539-6b3f-4072-862f-b596f37275f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4e235ee3144277b15d039b4f4b9978'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:46.565144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1001/1984] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:46 2022] DELETE /identity/v3/users/3a4e235ee3144277b15d039b4f4b9978 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:46.893652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.895850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:46.912523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdce0b-7aa8-420b-ad77-f3a037958102 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.973871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.974573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.974850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.975123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] PATH_INFO: `/v3/projects/5c385f157a594009b24f0c7ad4e3ee88` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.976243 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c385f157a594009b24f0c7ad4e3ee88)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.978193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.008539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:47.025532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c385f157a594009b24f0c7ad4e3ee88', 'request_id': 'req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:47.031594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c385f157a594009b24f0c7ad4e3ee88', 'request_id': 'req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:47.037483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c385f157a594009b24f0c7ad4e3ee88', 'request_id': 'req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:47.050223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] The token cache is being invalidate because project 5c385f157a594009b24f0c7ad4e3ee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:47.050508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:47.051182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-58de614a-9f14-4afd-b0d8-b9c4fc34f2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:47.052593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 984/1985] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:46 2022] DELETE /identity/v3/projects/5c385f157a594009b24f0c7ad4e3ee88 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:47.057461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.057770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.058120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.079411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:47.080599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:47.137154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1002/1986] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:47.144276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.144557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.144823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.165409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:47.166700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:47.175001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 985/1987] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:47.179110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.188656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0416e2-8c92-4d76-99b9-e0d51d2ef9e3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.193757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.194397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.194677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.194949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.195715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:47.196018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.197612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.209740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1003/1988] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:47.214060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.223013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f0c1-af52-4926-8bea-b7bf73158bf4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.227637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.228549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.228549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.228729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.229361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.231295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.261876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 986/1989] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:47 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:47.264086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.274533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499b66-0fcc-464d-b6f5-e30b037e9567 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.330463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.331072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.331357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.331632 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.332266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.334796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.345459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:47.357520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1004/1990] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:47 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:47.361726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.372440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210e98-54d4-4584-a861-6194a8d60a7f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.376931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.377519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.377798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.378111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.378725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.380878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.394649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 987/1991] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:47.398412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.408262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea5a2f-05c3-4502-9a46-eb8d1829c3d0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.412911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba96dd0-a7d0-4266-9eca-58d88ae0223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.413502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba96dd0-a7d0-4266-9eca-58d88ae0223e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.413781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba96dd0-a7d0-4266-9eca-58d88ae0223e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.414085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba96dd0-a7d0-4266-9eca-58d88ae0223e admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.414717 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba96dd0-a7d0-4266-9eca-58d88ae0223e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.416306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba96dd0-a7d0-4266-9eca-58d88ae0223e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.427401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1005/1992] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:47.431409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.441251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148c697-52f5-41b4-be0b-674c28adb8c6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.446497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.447273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.447564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.447913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] PATH_INFO: `/v3/projects/afaa83600aad4f43a4ad88f91df6d4fa/users/40f0083f34624bb89c2de99e728340c6/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.464217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaa83600aad4f43a4ad88f91df6d4fa, user_id=40f0083f34624bb89c2de99e728340c6, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.466928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.481135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 988/1993] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:47 2022] PUT /identity/v3/projects/afaa83600aad4f43a4ad88f91df6d4fa/users/40f0083f34624bb89c2de99e728340c6/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:47.495366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.495843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.496267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.528159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] MFA Rules not processed for user `40f0083f34624bb89c2de99e728340c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:47.529357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:47.601697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1006/1994] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:47.612886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.615396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:47.677766 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01ba3-cccd-484d-b5f7-99d84465f078 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.682560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d8ef-f1a9-46fc-8e1f-f8533488197b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.683198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d8ef-f1a9-46fc-8e1f-f8533488197b service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.683439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d8ef-f1a9-46fc-8e1f-f8533488197b service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.683716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d8ef-f1a9-46fc-8e1f-f8533488197b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.692722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d8ef-f1a9-46fc-8e1f-f8533488197b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.694814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d8ef-f1a9-46fc-8e1f-f8533488197b service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.703749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 989/1995] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:54.020608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:54.022916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:54.087790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8ec3-3479-44d0-ae66-2b9e0d1fe2bf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:54.092276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:54.092900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:54.093177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:54.093449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] PATH_INFO: `/v3/users/fa7f1217c4fd402ba3a314a467b23925` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:54.094582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7f1217c4fd402ba3a314a467b23925)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:54.096491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:54.142959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7f1217c4fd402ba3a314a467b23925'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.150590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7f1217c4fd402ba3a314a467b23925'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.162734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7f1217c4fd402ba3a314a467b23925'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.163347 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7f1217c4fd402ba3a314a467b23925'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.167691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:54.172200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7f1217c4fd402ba3a314a467b23925'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.180427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1007/1996] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:54 2022] DELETE /identity/v3/users/fa7f1217c4fd402ba3a314a467b23925 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:54.185143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:54.185749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:54.185749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:54.205045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:54.206277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:54.264303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:54.277770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 990/1997] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:54.288442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:54.290391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:54.366104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825a869-beba-4a60-a884-fda87cc441ab admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:54.373989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99df08-2a48-478f-9d61-82cf90a90181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:54.374651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99df08-2a48-478f-9d61-82cf90a90181 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:54.374932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99df08-2a48-478f-9d61-82cf90a90181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:54.375202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99df08-2a48-478f-9d61-82cf90a90181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:54.392502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99df08-2a48-478f-9d61-82cf90a90181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:54.394431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99df08-2a48-478f-9d61-82cf90a90181 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:54.409250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1008/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:54.477125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:54.478618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:54.491618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c199da-b8b9-420f-aea5-a106a664e379 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:54.511202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:54.511907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:54.512321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:54.512505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] PATH_INFO: `/v3/users/5e2a47c1dc8745c29cfef09c0d3b4030` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:54.513794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2a47c1dc8745c29cfef09c0d3b4030)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:54.516046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:54.569594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2a47c1dc8745c29cfef09c0d3b4030'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.574914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2a47c1dc8745c29cfef09c0d3b4030'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.574914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2a47c1dc8745c29cfef09c0d3b4030'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.587928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2a47c1dc8745c29cfef09c0d3b4030'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.596223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2a47c1dc8745c29cfef09c0d3b4030'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:54.609123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 991/1999] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:54 2022] DELETE /identity/v3/users/5e2a47c1dc8745c29cfef09c0d3b4030 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:54.613766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:54.614079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:54.614356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:54.635928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:54.637159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:54.729801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1009/2000] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:54.734396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:54.736098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:54.803193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f3cc8-7515-428a-a5ee-127831f6f6b3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:54.807258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:54.807889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:54.808170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:54.808505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:54.821756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:54.825044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:54.840049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 992/2001] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:55.489206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.491462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.534771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30576-8765-4bef-9ec8-d5a10b88c60f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.552946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.553621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.553932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.554210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] PATH_INFO: `/v3/projects/aa022eea54f741e98e808af6e8902b60` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.556255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa022eea54f741e98e808af6e8902b60)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.569981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.583725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.585404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.626607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dd50-7d54-4111-91db-c5467c062c2f service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.660356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.661053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.661389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.663447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] PATH_INFO: `/v3/projects/353802c01e094e879206f68c25bcd220` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.668544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353802c01e094e879206f68c25bcd220)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.672911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.697957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa022eea54f741e98e808af6e8902b60', 'request_id': 'req-d9b279a3-7750-4536-8145-1564b46615b5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.707744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa022eea54f741e98e808af6e8902b60', 'request_id': 'req-d9b279a3-7750-4536-8145-1564b46615b5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.716654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa022eea54f741e98e808af6e8902b60', 'request_id': 'req-d9b279a3-7750-4536-8145-1564b46615b5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.731328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] The token cache is being invalidate because project aa022eea54f741e98e808af6e8902b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:55.731668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.732231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d9b279a3-7750-4536-8145-1564b46615b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.733731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1010/2002] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:55 2022] DELETE /identity/v3/projects/aa022eea54f741e98e808af6e8902b60 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:55.739235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e24eb-bec9-41cc-a287-bfefbea9755f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.739725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e24eb-bec9-41cc-a287-bfefbea9755f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.739998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e24eb-bec9-41cc-a287-bfefbea9755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.746679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353802c01e094e879206f68c25bcd220', 'request_id': 'req-2d8ca1b0-7a9e-461e-96fb-c3150da56580'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.753334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353802c01e094e879206f68c25bcd220', 'request_id': 'req-2d8ca1b0-7a9e-461e-96fb-c3150da56580'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.760112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353802c01e094e879206f68c25bcd220', 'request_id': 'req-2d8ca1b0-7a9e-461e-96fb-c3150da56580'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.765451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:55.767050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dd7e24eb-bec9-41cc-a287-bfefbea9755f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:55.768757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dd7e24eb-bec9-41cc-a287-bfefbea9755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.785546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] The token cache is being invalidate because project 353802c01e094e879206f68c25bcd220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:55.785865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.786534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2d8ca1b0-7a9e-461e-96fb-c3150da56580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:55.788798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 993/2003] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:55 2022] DELETE /identity/v3/projects/353802c01e094e879206f68c25bcd220 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:55.791587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:55.797529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5b5b2-d6c6-421a-b56c-454f6a97d488 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.797924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5b5b2-d6c6-421a-b56c-454f6a97d488 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.798162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5b5b2-d6c6-421a-b56c-454f6a97d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.822892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-20d5b5b2-d6c6-421a-b56c-454f6a97d488 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:55.824112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-20d5b5b2-d6c6-421a-b56c-454f6a97d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.854431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1011/2004] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:55.862970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.863825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.864111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.884898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:55.886163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.895130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1012/2005] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:55.899199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.909982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 994/2006] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:19:55.910211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c2473-5e87-4aab-96d1-a0995470c846 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.917548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.917875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.918134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.931423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.932075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.932322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.932597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.933327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:55.933633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.935934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.941117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:55.942911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.949793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1013/2007] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:55.953874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.956221 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 995/2008] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:55.960175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.964616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe66f8-3a94-4f34-acea-2e254e958f5e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.969070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43485-44aa-4528-920f-24abeedef154 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.971125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.971861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.972543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.972543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.973884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.975931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.977208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.977812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.978122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.978391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.979040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:55.979340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.980922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.995409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 996/2009] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:56.000224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.010381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1014/2010] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:56.011041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561107b6-5bab-4dfe-ae71-f277c99c0c29 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.014203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.090294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adad046-9991-4c85-8279-98c3d613711f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.096404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.097216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.098286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.098704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.099486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.101557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.106122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.106811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.107127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.107361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.108628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.110732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.134085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1015/2011] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:56 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:56.135519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.147115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315286-f1a3-4a83-b0a8-a01f6e5cfebe admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.152094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.152745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.153021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.153293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.153962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.155641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.155830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 997/2012] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:19:56.156813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.174380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1016/2013] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:56.175910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.202461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275dae-5712-4258-a171-b0be32fdf212 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.278160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611e7e-885b-4495-8f7b-13d7edf73995 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.282413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:56.284132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.284774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.286164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.286164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.286346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.288408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.303090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:56.305064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.305829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.306218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.306865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.307195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.308834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.321183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1017/2014] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:56.325400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.327081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 998/2015] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:56 2022] POST /identity/v3/users => generated 280 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:56.331253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.343273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a0b01-0009-4c37-b8fc-fb1d7a9ae8c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.349051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.350204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.350677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.351099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.351967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.353904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.359974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82141176-9020-4b95-bf6b-169b74d285e0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.371833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca96a0-e833-46de-b105-9ba75a2e72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.372174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca96a0-e833-46de-b105-9ba75a2e72fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.372468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca96a0-e833-46de-b105-9ba75a2e72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.372792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca96a0-e833-46de-b105-9ba75a2e72fb admin admin] PATH_INFO: `/v3/projects/329432767730409fa24c415e9366b7ed/users/7c51c435272a41e98097bcdac9bf678e/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.372974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 999/2016] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:56.374107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.388898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651494b-ff93-4ed5-911b-b70a2b374778 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.395169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.396126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.396603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.397365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.400185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.402377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.413621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca96a0-e833-46de-b105-9ba75a2e72fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=329432767730409fa24c415e9366b7ed, user_id=7c51c435272a41e98097bcdac9bf678e, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.419309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca96a0-e833-46de-b105-9ba75a2e72fb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.424134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1000/2017] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:56.425339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.440928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1018/2018] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:56 2022] PUT /identity/v3/projects/329432767730409fa24c415e9366b7ed/users/7c51c435272a41e98097bcdac9bf678e/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:56.444174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbdb8-f3c1-4381-842d-23cfef864b1e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.455079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661290b-df55-4f7a-a50a-33c18c97b300 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.455079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661290b-df55-4f7a-a50a-33c18c97b300 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.455380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661290b-df55-4f7a-a50a-33c18c97b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.486344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c661290b-df55-4f7a-a50a-33c18c97b300 None None] MFA Rules not processed for user `7c51c435272a41e98097bcdac9bf678e`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:56.489014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c661290b-df55-4f7a-a50a-33c18c97b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:56.528819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.529482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.529758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.530076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] PATH_INFO: `/v3/projects/ef92ebd24fb2416695e5a247e91b5e75/users/18e0cd0b7cc14971a71397ff349e87bc/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.551862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef92ebd24fb2416695e5a247e91b5e75, user_id=18e0cd0b7cc14971a71397ff349e87bc, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.556628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.578623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1019/2019] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:56.584328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1001/2020] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:56 2022] PUT /identity/v3/projects/ef92ebd24fb2416695e5a247e91b5e75/users/18e0cd0b7cc14971a71397ff349e87bc/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:19:56.595573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.595757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.596078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.596336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.598227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:56.628301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] MFA Rules not processed for user `18e0cd0b7cc14971a71397ff349e87bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:56.629664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:56.688841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee822-d025-40ac-b1f8-7e8480f02c16 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.693723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.694396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.695224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.695699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.734060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1020/2021] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:56.794948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.796466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.813478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1002/2022] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:19:57.024019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:57.027218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:57.056611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4a61-c548-4d3a-9d3d-1be87c509f78 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:57.068573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c782-8719-491f-8d1b-52bec77b737f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:57.069207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c782-8719-491f-8d1b-52bec77b737f service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:57.069482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c782-8719-491f-8d1b-52bec77b737f service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:57.069749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c782-8719-491f-8d1b-52bec77b737f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:57.092069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c782-8719-491f-8d1b-52bec77b737f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:57.093997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c782-8719-491f-8d1b-52bec77b737f service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:57.116955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1021/2023] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:57.124122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:57.132925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:57.222150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16423e6-9f25-45e6-b833-80ac6c1e11e0 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:57.237935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:57.239604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:57.239839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:57.240123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] PATH_INFO: `/v3/users/18e0cd0b7cc14971a71397ff349e87bc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:57.241392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e0cd0b7cc14971a71397ff349e87bc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:57.243702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:57.385608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e0cd0b7cc14971a71397ff349e87bc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:57.387821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e0cd0b7cc14971a71397ff349e87bc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:57.394324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e0cd0b7cc14971a71397ff349e87bc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:57.427744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e0cd0b7cc14971a71397ff349e87bc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:57.457988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e0cd0b7cc14971a71397ff349e87bc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:57.505175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1003/2024] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:19:57 2022] DELETE /identity/v3/users/18e0cd0b7cc14971a71397ff349e87bc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:57.509875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:57.510243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:57.510678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:57.556813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:57.560425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:57.627504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:57.685523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1022/2025] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:57.696677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:57.698392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:57.868027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc9d3-0a76-4f8d-ad00-9f2f18ce7d24 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:57.877919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab441992-7a36-4cbd-ac07-efac1b028c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:57.878862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441992-7a36-4cbd-ac07-efac1b028c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:57.879900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441992-7a36-4cbd-ac07-efac1b028c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:57.880359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441992-7a36-4cbd-ac07-efac1b028c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:57.895105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441992-7a36-4cbd-ac07-efac1b028c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:57.897499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441992-7a36-4cbd-ac07-efac1b028c3f service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:57.920162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1004/2026] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:58.395792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:58.397376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:58.420186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d402-dbc7-4c94-b316-1a19ec4463b3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:58.433523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:58.434329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.434680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.435024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] PATH_INFO: `/v3/projects/ef92ebd24fb2416695e5a247e91b5e75` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.436312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef92ebd24fb2416695e5a247e91b5e75)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:58.438570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:58.509778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef92ebd24fb2416695e5a247e91b5e75', 'request_id': 'req-262d95b2-a9bc-4450-a2c5-7b89681a0567'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:58.522453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef92ebd24fb2416695e5a247e91b5e75', 'request_id': 'req-262d95b2-a9bc-4450-a2c5-7b89681a0567'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:58.530545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef92ebd24fb2416695e5a247e91b5e75', 'request_id': 'req-262d95b2-a9bc-4450-a2c5-7b89681a0567'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:58.547409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] The token cache is being invalidate because project ef92ebd24fb2416695e5a247e91b5e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:19:58.547697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:58.548806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-262d95b2-a9bc-4450-a2c5-7b89681a0567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:19:58.550369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1023/2027] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:19:58 2022] DELETE /identity/v3/projects/ef92ebd24fb2416695e5a247e91b5e75 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:58.556329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.556669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.556884 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.577315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:58.578558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:58.656880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:58.799438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1005/2028] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:58.808603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.812991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.814703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.866985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:58.867635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:58.891462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:58.902949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1024/2029] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:58.910972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32bc6-00aa-4162-b6b0-26c3bc3b353b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:58.921629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:58.922426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.922715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.923087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.925163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:58.925651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:58.929816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:58.964373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1006/2030] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:58.969728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:58.989669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11535c37-6dd2-4634-9a34-179efaa02a4c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.007623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.008926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.009473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.009755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.010433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.012548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.078418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1025/2031] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:19:58 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:59.081474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:59.093465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb259ca-8096-4bf4-a4bb-cb74620423ab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.230911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.230911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.230911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.230911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.231193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.231193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.310663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:59.325747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1007/2032] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:59 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:59.331735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4a6c-8514-4732-88de-e91a43162798 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.347409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.362688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.363639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.364243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.365550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.368173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.392612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:59.403156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aac8e-cf20-4668-b0cb-544002406855 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.403964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1026/2033] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:59.409497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef69e-469d-4ca5-90ca-b542311d0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.410465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef69e-469d-4ca5-90ca-b542311d0b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.410852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef69e-469d-4ca5-90ca-b542311d0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.411160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef69e-469d-4ca5-90ca-b542311d0b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.411885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef69e-469d-4ca5-90ca-b542311d0b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.413722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef69e-469d-4ca5-90ca-b542311d0b47 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.463163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:59.468901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1008/2034] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:59.475047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781c498-78b7-4a1c-9253-bd45d5cb7154 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.484725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.485716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.486222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.486578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] PATH_INFO: `/v3/projects/9f15ffcbae924b52830ebc980091bf40/users/efd87db4f6344050b39048acdd3cdd56/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.536055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f15ffcbae924b52830ebc980091bf40, user_id=efd87db4f6344050b39048acdd3cdd56, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.543914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.575130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1027/2035] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:19:59 2022] PUT /identity/v3/projects/9f15ffcbae924b52830ebc980091bf40/users/efd87db4f6344050b39048acdd3cdd56/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:59.587620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55761-1d07-46c4-9263-01173c676f06 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.587902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55761-1d07-46c4-9263-01173c676f06 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.588174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55761-1d07-46c4-9263-01173c676f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.654080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-53f55761-1d07-46c4-9263-01173c676f06 None None] MFA Rules not processed for user `efd87db4f6344050b39048acdd3cdd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:59.655779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-53f55761-1d07-46c4-9263-01173c676f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:59.743756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1009/2036] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:19:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:59.755551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:59.757600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:59.838620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e068be-d062-4212-9f52-a2451061be50 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.842515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.843121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.843518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.843644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.858339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.858569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.864973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:59.882820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1028/2037] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:01.342401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a501a-e062-4cb5-bce8-49a42d26c1ce None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:01.343526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a501a-e062-4cb5-bce8-49a42d26c1ce None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:01.344627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a501a-e062-4cb5-bce8-49a42d26c1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:01.381305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f10a501a-e062-4cb5-bce8-49a42d26c1ce None None] MFA Rules not processed for user `efd87db4f6344050b39048acdd3cdd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:01.382591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f10a501a-e062-4cb5-bce8-49a42d26c1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:01.390334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1010/2038] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:08.913042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.914498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:08.989631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17d68-a25d-4d42-ab2b-17afe2f77b7a service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.995178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.995816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.996238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.996517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] PATH_INFO: `/v3/users/7c51c435272a41e98097bcdac9bf678e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.997768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c51c435272a41e98097bcdac9bf678e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.999773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.054852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c51c435272a41e98097bcdac9bf678e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.063220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c51c435272a41e98097bcdac9bf678e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.077066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c51c435272a41e98097bcdac9bf678e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.077740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c51c435272a41e98097bcdac9bf678e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.085277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c51c435272a41e98097bcdac9bf678e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.091608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1029/2039] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:08 2022] DELETE /identity/v3/users/7c51c435272a41e98097bcdac9bf678e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:09.096233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.096701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.096795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.116796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:09.118086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.127391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:09.179755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1011/2040] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:09.189355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.190830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.253323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4731cc-078d-4adf-9e7f-32878bd794fa admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.257363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bf371-e905-4884-a88f-51692f5271b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.258129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bf371-e905-4884-a88f-51692f5271b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.258412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bf371-e905-4884-a88f-51692f5271b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.258684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bf371-e905-4884-a88f-51692f5271b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.271040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bf371-e905-4884-a88f-51692f5271b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.272690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bf371-e905-4884-a88f-51692f5271b6 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.283630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1030/2041] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:09.558398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.559856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.574580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383026f-d7bc-4850-8993-7cc04008c747 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.580247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.580925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.581139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.582259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] PATH_INFO: `/v3/projects/329432767730409fa24c415e9366b7ed` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.583497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=329432767730409fa24c415e9366b7ed)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.585237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.631216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329432767730409fa24c415e9366b7ed', 'request_id': 'req-525503b0-ac77-475d-b5f3-760faa23ad4a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.637281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329432767730409fa24c415e9366b7ed', 'request_id': 'req-525503b0-ac77-475d-b5f3-760faa23ad4a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.643044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329432767730409fa24c415e9366b7ed', 'request_id': 'req-525503b0-ac77-475d-b5f3-760faa23ad4a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.655703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] The token cache is being invalidate because project 329432767730409fa24c415e9366b7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:09.655985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.656633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-525503b0-ac77-475d-b5f3-760faa23ad4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:09.658189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1012/2042] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:09 2022] DELETE /identity/v3/projects/329432767730409fa24c415e9366b7ed => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:09.663115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.663442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.663730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.683123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:09.684312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.697446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:09.746787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1031/2043] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:09.755237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.755515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.755782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.775791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:09.777005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.789779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1013/2044] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:09.794035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.803976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ac7ec-56d1-4b56-a71b-649aa6a53c05 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.813235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.813880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.814171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.814445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.815094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:09.815398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.817546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.829652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1032/2045] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:09.834626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.843750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d9df-07a9-4b65-bbeb-901d4a274abd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.848407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.849010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.849288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.849560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.850223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.852130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.889584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1014/2046] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:09.893570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.906823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765ad49-aed7-4a5d-8cf1-487e0ad5b7ac admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.966902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.967551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.967773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.968048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.968950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.970655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.992884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1033/2047] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:09.996723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.007800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed517587-6c4b-4748-b2cf-c6a712d810be admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.016317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.017039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.017500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.017775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.018518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.020124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.033516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1015/2048] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:10.034903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.045327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0091-fc4b-48d4-8dd9-b30c9e243242 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.052136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05e75d-410c-4fbd-9669-8551294889e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.052844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e75d-410c-4fbd-9669-8551294889e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.053227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e75d-410c-4fbd-9669-8551294889e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.053601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e75d-410c-4fbd-9669-8551294889e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.054414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05e75d-410c-4fbd-9669-8551294889e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.056114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05e75d-410c-4fbd-9669-8551294889e9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.072537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1034/2049] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:10.073732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.083748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616753b-a60d-4827-bb39-88268f8e88f4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.088368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.089016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.089294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.089565 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] PATH_INFO: `/v3/projects/96ac355089a14695a3e062290443283e/users/cdd2a01bf81d406e877a1c4ace635704/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.104593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ac355089a14695a3e062290443283e, user_id=cdd2a01bf81d406e877a1c4ace635704, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.107343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.121485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1016/2050] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:10 2022] PUT /identity/v3/projects/96ac355089a14695a3e062290443283e/users/cdd2a01bf81d406e877a1c4ace635704/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:10.126956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.127236 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.127531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.151554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:10.152812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.214088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1035/2051] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:10.224290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.225996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.267227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:10.286127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459d7c8-f041-49b8-a117-14b8627619e3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.289798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30454ef3-db38-4f89-a399-96e3ca2031b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.290430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454ef3-db38-4f89-a399-96e3ca2031b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.290711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454ef3-db38-4f89-a399-96e3ca2031b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.291108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454ef3-db38-4f89-a399-96e3ca2031b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.306624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30454ef3-db38-4f89-a399-96e3ca2031b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.308082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30454ef3-db38-4f89-a399-96e3ca2031b2 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.318252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1017/2052] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:10.661403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.662826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.679046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779fcf9-2bdc-4f9d-b8ac-a6d5e144b2e2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.684808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.685446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.685732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.686297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] PATH_INFO: `/v3/users/eb0b20485a664bf697627f9f7dfe0c33` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.687440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0b20485a664bf697627f9f7dfe0c33)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.689370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.718954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:10.754914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0b20485a664bf697627f9f7dfe0c33'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:10.762516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0b20485a664bf697627f9f7dfe0c33'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:10.775926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0b20485a664bf697627f9f7dfe0c33'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:10.776610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0b20485a664bf697627f9f7dfe0c33'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:10.783423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0b20485a664bf697627f9f7dfe0c33'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:10.790193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1036/2053] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:10 2022] DELETE /identity/v3/users/eb0b20485a664bf697627f9f7dfe0c33 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:10.794584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.794829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.795096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.815695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:10.817596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.883651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1018/2054] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:10.896125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.898749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.988517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb7a7-1e26-4e83-8d4b-c6e27dd927c9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.993796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.994680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.994956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.995234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.013382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.014886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.043454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1037/2055] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:11.580936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.583054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:11.603485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39125-c550-4981-bd61-93ce2e8d6393 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.608166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.608811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.609093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.609371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] PATH_INFO: `/v3/projects/2cedc66af1f34b7d9879716192985b35` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.610510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cedc66af1f34b7d9879716192985b35)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.612440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.671153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cedc66af1f34b7d9879716192985b35', 'request_id': 'req-8a716e31-4b5b-4885-95dc-1ef06770e82c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.682258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cedc66af1f34b7d9879716192985b35', 'request_id': 'req-8a716e31-4b5b-4885-95dc-1ef06770e82c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.693106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cedc66af1f34b7d9879716192985b35', 'request_id': 'req-8a716e31-4b5b-4885-95dc-1ef06770e82c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.706276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] The token cache is being invalidate because project 2cedc66af1f34b7d9879716192985b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:11.708013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.708698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.711969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1019/2056] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:11 2022] DELETE /identity/v3/projects/2cedc66af1f34b7d9879716192985b35 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:11.716272 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.728383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f78ef-e4ba-42e4-b005-e98175a17631 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.816007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.816668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.816952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.817230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] PATH_INFO: `/v3/users/3095ceb9d51a4c7ba640c4556ffa8d05` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.818907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3095ceb9d51a4c7ba640c4556ffa8d05)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.820660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.872343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:11.875115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3095ceb9d51a4c7ba640c4556ffa8d05'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.885562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3095ceb9d51a4c7ba640c4556ffa8d05'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.902190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3095ceb9d51a4c7ba640c4556ffa8d05'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.902970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3095ceb9d51a4c7ba640c4556ffa8d05'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.914459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5196fd3f-d2de-4484-86c2-30692a229f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3095ceb9d51a4c7ba640c4556ffa8d05'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:11.924830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1038/2057] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:11 2022] DELETE /identity/v3/users/3095ceb9d51a4c7ba640c4556ffa8d05 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:12.326104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.328628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:12.357653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716e31-4b5b-4885-95dc-1ef06770e82c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.476685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.477330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.477609 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.477905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] PATH_INFO: `/v3/projects/35cc2e2c61f74b7aa00fb8d2778bf135` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.480504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cc2e2c61f74b7aa00fb8d2778bf135)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.484791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.488755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:12.562801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cc2e2c61f74b7aa00fb8d2778bf135', 'request_id': 'req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:12.570487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cc2e2c61f74b7aa00fb8d2778bf135', 'request_id': 'req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:12.579257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cc2e2c61f74b7aa00fb8d2778bf135', 'request_id': 'req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:12.596569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] The token cache is being invalidate because project 35cc2e2c61f74b7aa00fb8d2778bf135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:12.597241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:12.598052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9766f6d7-65b3-4b3b-aca9-e501b99b9ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:12.599679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1020/2058] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:12 2022] DELETE /identity/v3/projects/35cc2e2c61f74b7aa00fb8d2778bf135 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:12.604746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.605259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.605259 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.628853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:12.629965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:12.726399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1039/2059] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:12.734249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.734760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.735039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.755889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:12.757111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:12.765480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1021/2060] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:12.770511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.783271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72963387-6e3e-4260-80c0-870dd73eb639 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.791913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.792930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.793215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.793820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.794541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:12.795183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.800758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.817110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1040/2061] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:12.821425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.860688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85eb2b-cdd7-4211-b1f3-a6a2f19c3d1c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.886608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.887056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.887336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.897756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.899968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.912308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.990718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1022/2062] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:12 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:12.994835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.010312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6faf4-f151-416e-bf54-d6ff84c5d583 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.144546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.145144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.145466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.145746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.149030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.155920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.239446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1041/2063] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:12 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:13.240671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.256380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d7db6-db21-4b65-a1a8-bca43f42531e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.273919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.274563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.274846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.275119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.275793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.277458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.307822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1023/2064] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:13.309256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.325782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db000d-6467-4c36-a4d1-1356a1a51248 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.330415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762dbe9-81a0-4bc0-a146-54f7fc8d1fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.331278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762dbe9-81a0-4bc0-a146-54f7fc8d1fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.331658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762dbe9-81a0-4bc0-a146-54f7fc8d1fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.332057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762dbe9-81a0-4bc0-a146-54f7fc8d1fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.332878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762dbe9-81a0-4bc0-a146-54f7fc8d1fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.334700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762dbe9-81a0-4bc0-a146-54f7fc8d1fdf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.371813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1042/2065] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:13.375636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.387070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639c5bb-b876-495d-a254-376f34b58916 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.392385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.393281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.393752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.394198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] PATH_INFO: `/v3/projects/3fff3ffd0ec14ebab745ed9a88e2453d/users/fe99fe99a1214e5cb5e7d9a7f2fa9eeb/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.412337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fff3ffd0ec14ebab745ed9a88e2453d, user_id=fe99fe99a1214e5cb5e7d9a7f2fa9eeb, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.416983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.451506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1024/2066] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:13 2022] PUT /identity/v3/projects/3fff3ffd0ec14ebab745ed9a88e2453d/users/fe99fe99a1214e5cb5e7d9a7f2fa9eeb/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:13.453385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.453811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.454465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.508451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] MFA Rules not processed for user `fe99fe99a1214e5cb5e7d9a7f2fa9eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:13.512025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:13.542064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:13.644345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1043/2067] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:13.652080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.788450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e24720-1f14-406c-bba9-fc9d54a0c0b8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.807719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.808710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.809428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.809803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.810576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.814047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.889738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1025/2068] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:13 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:13.890335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.903849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf843df-4801-4e8b-95e6-c22326a02a90 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.973420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.973748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.974050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.974304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.974944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.976877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.022382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1044/2069] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:13 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:14.025142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.040276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfe00-f2a9-4c38-9d1e-a2f36f92a614 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.062624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.063993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.064505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.065429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.066854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.069695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.091415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1026/2070] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:14.093356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.108353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e595d-8014-4e55-a79c-4dc59f070a9a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.123402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.124244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.124527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.124800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] PATH_INFO: `/v3/projects/eeaf60ade83c4be4ae589eaba60ebd40/users/8837dbd5ac04490ba45a10e68fd604c0/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.173914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaf60ade83c4be4ae589eaba60ebd40, user_id=8837dbd5ac04490ba45a10e68fd604c0, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.175792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.197265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1045/2071] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:14 2022] PUT /identity/v3/projects/eeaf60ade83c4be4ae589eaba60ebd40/users/8837dbd5ac04490ba45a10e68fd604c0/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:14.201339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.207335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:14.222580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80634d-0400-48ba-b28e-43e6f92b7658 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.337528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89af65-3d7b-4d5a-ac31-c2b1a5922509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.338391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89af65-3d7b-4d5a-ac31-c2b1a5922509 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.338718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89af65-3d7b-4d5a-ac31-c2b1a5922509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.338933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89af65-3d7b-4d5a-ac31-c2b1a5922509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.339586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89af65-3d7b-4d5a-ac31-c2b1a5922509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.341189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89af65-3d7b-4d5a-ac31-c2b1a5922509 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.367195 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1027/2072] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:14.369238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.392245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b984b-4575-4a59-acf2-b1c5c489dcf8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.399666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.400603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.400874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.401142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] PATH_INFO: `/v3/projects/eeaf60ade83c4be4ae589eaba60ebd40/users/8837dbd5ac04490ba45a10e68fd604c0/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.407459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaf60ade83c4be4ae589eaba60ebd40, user_id=8837dbd5ac04490ba45a10e68fd604c0, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.410367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.439076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1046/2073] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:14 2022] PUT /identity/v3/projects/eeaf60ade83c4be4ae589eaba60ebd40/users/8837dbd5ac04490ba45a10e68fd604c0/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:14.449978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.450497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.450968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.492271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] MFA Rules not processed for user `8837dbd5ac04490ba45a10e68fd604c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:14.493524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:14.583945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1028/2074] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:14.595220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.597888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:14.676895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a76e-7f53-4fa9-abca-e988d0bb5d0b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.681219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58061a-c2d3-44d7-8db1-486230ff180f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.681963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58061a-c2d3-44d7-8db1-486230ff180f service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.682453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58061a-c2d3-44d7-8db1-486230ff180f service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.682726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58061a-c2d3-44d7-8db1-486230ff180f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.693269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58061a-c2d3-44d7-8db1-486230ff180f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.694980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58061a-c2d3-44d7-8db1-486230ff180f service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.706961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1047/2075] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:15.316729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:15.388716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c6cf-9f39-4978-8e15-bcf130c3b448 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.395886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.396617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.396962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.397339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] PATH_INFO: `/v3/users/fe99fe99a1214e5cb5e7d9a7f2fa9eeb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.398653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe99fe99a1214e5cb5e7d9a7f2fa9eeb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.400854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:15.454303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:15.492370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe99fe99a1214e5cb5e7d9a7f2fa9eeb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.493261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe99fe99a1214e5cb5e7d9a7f2fa9eeb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.494025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe99fe99a1214e5cb5e7d9a7f2fa9eeb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.515888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe99fe99a1214e5cb5e7d9a7f2fa9eeb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.532645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe99fe99a1214e5cb5e7d9a7f2fa9eeb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.566552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1029/2076] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:15 2022] DELETE /identity/v3/users/fe99fe99a1214e5cb5e7d9a7f2fa9eeb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:15.571297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d8cb-a6f1-45bf-8766-566f99cf9ce2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.571580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d8cb-a6f1-45bf-8766-566f99cf9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.571905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d8cb-a6f1-45bf-8766-566f99cf9ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.596520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-38b9d8cb-a6f1-45bf-8766-566f99cf9ce2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:15.597993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-38b9d8cb-a6f1-45bf-8766-566f99cf9ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:15.608445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:15.710659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1048/2077] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:15.720332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:15.721810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:15.772173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.772458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.772732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.814238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] MFA Rules not processed for user `cdd2a01bf81d406e877a1c4ace635704`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:15.816068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:15.853785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9abdb-2f4b-48c9-a90a-da72553e91f4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.860363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.861033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.861321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.861630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.876393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.878752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:15.892125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1030/2078] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:15.932498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1049/2079] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:15.936976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:15.938435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:15.967775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35eedb-43e3-4268-bf63-e7aadab5c990 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.974943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.975567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.975845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.976117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.978204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.981116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.038857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1031/2080] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:16.043312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.063332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c891a-5af2-4595-a91b-66d2c73efd59 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.165821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.166641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.167030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.167403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.168166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.170643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.203258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1050/2081] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:16 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:16.204812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.218720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0675-e6d1-4f3e-86ee-9b0406e84ddf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.224295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.225469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.225469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.225703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.226396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.228029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.240563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1032/2082] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:16.244969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.257395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316a4f-3f26-4312-a950-53534e7d1cf1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.266639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.267323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.267639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.267905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] PATH_INFO: `/v3/projects/2ad4273b3e174ffc971766fc7a30a20c/users/435115d080c8427c9d21c93cc058774d/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.289676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad4273b3e174ffc971766fc7a30a20c, user_id=435115d080c8427c9d21c93cc058774d, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.292494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.309222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1051/2083] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:16 2022] PUT /identity/v3/projects/2ad4273b3e174ffc971766fc7a30a20c/users/435115d080c8427c9d21c93cc058774d/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:16.311447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.313663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:16.328467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.335929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c17b-f0ee-40c4-b071-39b4a70080ea admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.349413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:16.412337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7001655-1dec-40a9-a6c4-5b2a01fbda00 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.418241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.418940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.419215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.419489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.419597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.420133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.420372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.420775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.421058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] PATH_INFO: `/v3/projects/3fff3ffd0ec14ebab745ed9a88e2453d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.422430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.422549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fff3ffd0ec14ebab745ed9a88e2453d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.424585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.434526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1052/2084] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:16.438493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.444995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:16.451462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb675-4388-48c9-9ba7-b8b2ce8cdd34 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.465563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.466467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.466660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.467025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] PATH_INFO: `/v3/projects/2ad4273b3e174ffc971766fc7a30a20c/users/435115d080c8427c9d21c93cc058774d/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.469350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad4273b3e174ffc971766fc7a30a20c, user_id=435115d080c8427c9d21c93cc058774d, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.472652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.490210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1053/2085] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:16 2022] PUT /identity/v3/projects/2ad4273b3e174ffc971766fc7a30a20c/users/435115d080c8427c9d21c93cc058774d/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:16.502531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fff3ffd0ec14ebab745ed9a88e2453d', 'request_id': 'req-c428f631-0ae3-4e36-925c-44b71e2608b1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.512345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fff3ffd0ec14ebab745ed9a88e2453d', 'request_id': 'req-c428f631-0ae3-4e36-925c-44b71e2608b1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.522807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fff3ffd0ec14ebab745ed9a88e2453d', 'request_id': 'req-c428f631-0ae3-4e36-925c-44b71e2608b1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.538900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] The token cache is being invalidate because project 3fff3ffd0ec14ebab745ed9a88e2453d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:16.539709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.540501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.544940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1033/2086] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:16 2022] DELETE /identity/v3/projects/3fff3ffd0ec14ebab745ed9a88e2453d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:16.546344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.548633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:16.624292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ab322-443d-4fb0-9eaf-0c3fb0df93e9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.688923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.689573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.689753 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.690053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] PATH_INFO: `/v3/users/8837dbd5ac04490ba45a10e68fd604c0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.691765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8837dbd5ac04490ba45a10e68fd604c0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.693701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.741012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:16.764036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8837dbd5ac04490ba45a10e68fd604c0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.774955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8837dbd5ac04490ba45a10e68fd604c0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.793926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8837dbd5ac04490ba45a10e68fd604c0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.794965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8837dbd5ac04490ba45a10e68fd604c0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.807368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d490387e-9e07-4c5a-827a-81e651d8d15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8837dbd5ac04490ba45a10e68fd604c0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.814906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1054/2087] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:16 2022] DELETE /identity/v3/users/8837dbd5ac04490ba45a10e68fd604c0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:17.524621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:17.541729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f631-0ae3-4e36-925c-44b71e2608b1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:17.626022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:17.627827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:17.628773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:17.629822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] PATH_INFO: `/v3/projects/eeaf60ade83c4be4ae589eaba60ebd40` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:17.633544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeaf60ade83c4be4ae589eaba60ebd40)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:17.636678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:17.705124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeaf60ade83c4be4ae589eaba60ebd40', 'request_id': 'req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:17.716169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeaf60ade83c4be4ae589eaba60ebd40', 'request_id': 'req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:17.724419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeaf60ade83c4be4ae589eaba60ebd40', 'request_id': 'req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:17.740678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] The token cache is being invalidate because project eeaf60ade83c4be4ae589eaba60ebd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:17.740965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:17.741599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e22e7125-b20d-4c0f-9ef7-1a87b75d4934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:17.743325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1034/2088] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:17 2022] DELETE /identity/v3/projects/eeaf60ade83c4be4ae589eaba60ebd40 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:17.752186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:17.752712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:17.752712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:17.776464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:17.778234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:17.866502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1055/2089] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:17.874599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:17.874941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:17.875244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:17.896051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:17.897249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:17.907368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1035/2090] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:17.911511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:17.921801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5002d3-2619-4155-9a30-a674c9a8e042 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:17.927157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:17.927820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:17.928104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:17.928375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:17.929029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:17.929329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:17.931414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:17.945661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1056/2091] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:17.949719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:17.964593 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6692e-e637-421d-8ccb-193d1b66d50f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:17.971612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:17.972945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:17.973381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:17.974665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:17.975797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:17.978278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.027600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1036/2092] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:17 2022] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:18.031476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.043935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b41eb-b200-4650-91b9-7e8fc81799f8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.120418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.121024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.121298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.121567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.122244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.124793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.155786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1057/2093] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:18 2022] POST /identity/v3/users => generated 301 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:18.158289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.174098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:18.179998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58373fa-6609-4252-a20a-bb2f8a51e845 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.187800 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.188723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.189213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.189506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.191058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.193280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.210250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1037/2094] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:18.210860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.222095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3432a4b-75f8-4469-9261-aa79270b8b67 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.226984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58859a-deb3-4b22-a6ae-b03d8e65cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.227689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58859a-deb3-4b22-a6ae-b03d8e65cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.228030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58859a-deb3-4b22-a6ae-b03d8e65cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.228377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58859a-deb3-4b22-a6ae-b03d8e65cf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.229088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58859a-deb3-4b22-a6ae-b03d8e65cf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.230803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58859a-deb3-4b22-a6ae-b03d8e65cf60 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.243807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1058/2095] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:18.247925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.259798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01dfe2-c012-4f83-a3b4-d1bb1ea47793 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.264847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.265583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.265966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.266312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] PATH_INFO: `/v3/projects/225466640f1c474ea2051f980efd9113/users/0a751629186549208a6634da941b4529/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.282549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225466640f1c474ea2051f980efd9113, user_id=0a751629186549208a6634da941b4529, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.285434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.298941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1038/2096] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:18 2022] PUT /identity/v3/projects/225466640f1c474ea2051f980efd9113/users/0a751629186549208a6634da941b4529/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:18.311767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.312185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.312464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.346754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] MFA Rules not processed for user `0a751629186549208a6634da941b4529`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:18.348137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:18.359756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:18.444669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1059/2097] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:18.453465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.558684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb3e1-9247-4932-be18-df7ec1220ee2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.564255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.564928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.565402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.565830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.566502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.568645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.603214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1039/2098] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:18 2022] POST /identity/v3/projects => generated 399 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:18.604062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.619004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a234c-f2ea-48a1-b3e7-4c14d37f1612 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.755962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.757987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.758862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.759221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.760306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.763050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.807476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1060/2099] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:18 2022] POST /identity/v3/users => generated 306 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:18.815763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.830070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db43f5b-a640-4a80-b2e5-a5e0832aa7fb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.836228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.837583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.838140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.838614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.839442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.842422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.878671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.879093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1040/2100] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:18.890603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e534-4478-43a1-b01a-1126489d4f96 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:18.896527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:18.897292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:18.897575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:18.897872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] PATH_INFO: `/v3/projects/5b03e7721ce442178a2c4719da942066/users/ccc7803e3b0a4ab7b6e7497bf90f2d87/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:18.922317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b03e7721ce442178a2c4719da942066, user_id=ccc7803e3b0a4ab7b6e7497bf90f2d87, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:18.928926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:18.951069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1061/2101] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:18 2022] PUT /identity/v3/projects/5b03e7721ce442178a2c4719da942066/users/ccc7803e3b0a4ab7b6e7497bf90f2d87/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:18.954710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.965820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a32a-d12e-4385-b085-7388a791c203 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.034161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29275baa-d99b-4cb3-b73b-bb44207f6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.035730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29275baa-d99b-4cb3-b73b-bb44207f6e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.036415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29275baa-d99b-4cb3-b73b-bb44207f6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.036921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29275baa-d99b-4cb3-b73b-bb44207f6e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.038492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29275baa-d99b-4cb3-b73b-bb44207f6e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.040878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29275baa-d99b-4cb3-b73b-bb44207f6e3b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.058675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1041/2102] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:19.060371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:19.072568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf139b-b13d-4f69-aa3c-d04401be3b50 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.078333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.079137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.079486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.079894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] PATH_INFO: `/v3/projects/5b03e7721ce442178a2c4719da942066/users/ccc7803e3b0a4ab7b6e7497bf90f2d87/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.083055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b03e7721ce442178a2c4719da942066, user_id=ccc7803e3b0a4ab7b6e7497bf90f2d87, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.086179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.101088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1062/2103] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:19 2022] PUT /identity/v3/projects/5b03e7721ce442178a2c4719da942066/users/ccc7803e3b0a4ab7b6e7497bf90f2d87/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:19.111871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.112149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.112472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.145735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] MFA Rules not processed for user `ccc7803e3b0a4ab7b6e7497bf90f2d87`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:19.146957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:19.204631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:19.294823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1042/2104] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:19.305709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:19.307379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:19.462443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf5ed-9fae-4a1b-9539-7cbf6cb72985 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.466720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.467526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.467814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.468240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.480083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.482230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.494911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1063/2105] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:19 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:19.604607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:19.619476 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dd814-e766-48ed-bdb5-1c929140f2b2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.624353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da6810-b2ba-4991-90ff-ccaf4ebe0a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.626006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da6810-b2ba-4991-90ff-ccaf4ebe0a54 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.626151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da6810-b2ba-4991-90ff-ccaf4ebe0a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.626576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da6810-b2ba-4991-90ff-ccaf4ebe0a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.758405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da6810-b2ba-4991-90ff-ccaf4ebe0a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.760457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da6810-b2ba-4991-90ff-ccaf4ebe0a54 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.776983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1043/2106] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:19 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:20.316510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:20.318030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:20.330324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:20.433040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02097628-164f-4c12-85e6-c71b763a611e service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:20.440494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:20.441446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:20.441823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:20.442224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] PATH_INFO: `/v3/users/40f0083f34624bb89c2de99e728340c6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:20.443537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f0083f34624bb89c2de99e728340c6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:20.445795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:20.533370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f0083f34624bb89c2de99e728340c6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.546594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f0083f34624bb89c2de99e728340c6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.626219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f0083f34624bb89c2de99e728340c6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.626982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f0083f34624bb89c2de99e728340c6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.645710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f0083f34624bb89c2de99e728340c6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.662486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1064/2107] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:20 2022] DELETE /identity/v3/users/40f0083f34624bb89c2de99e728340c6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:20.667181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:20.667840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:20.667840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:20.714984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:20.716239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:20.850562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1044/2108] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:20.874843 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:20.876587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.033168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4fa6-f229-453c-a41e-ee500e12a720 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:21.037263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf9c33-f51d-4d15-8be9-e4fc637a341c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:21.038233 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf9c33-f51d-4d15-8be9-e4fc637a341c service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.038867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf9c33-f51d-4d15-8be9-e4fc637a341c service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.040310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf9c33-f51d-4d15-8be9-e4fc637a341c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:21.062603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf9c33-f51d-4d15-8be9-e4fc637a341c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:21.066218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf9c33-f51d-4d15-8be9-e4fc637a341c service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:21.102015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1065/2109] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:21.964524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:21.966006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.984379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9941150-d3ea-4b03-882e-c54d6a82cad1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:21.992458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:21.993366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.993787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.994237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] PATH_INFO: `/v3/projects/afaa83600aad4f43a4ad88f91df6d4fa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.000725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaa83600aad4f43a4ad88f91df6d4fa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.003103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.097587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaa83600aad4f43a4ad88f91df6d4fa', 'request_id': 'req-0919efff-37e9-4f90-b602-0472ae8ee3ef'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.106719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaa83600aad4f43a4ad88f91df6d4fa', 'request_id': 'req-0919efff-37e9-4f90-b602-0472ae8ee3ef'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.111542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:22.120572 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaa83600aad4f43a4ad88f91df6d4fa', 'request_id': 'req-0919efff-37e9-4f90-b602-0472ae8ee3ef'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.138744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] The token cache is being invalidate because project afaa83600aad4f43a4ad88f91df6d4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:22.139036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.139715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0919efff-37e9-4f90-b602-0472ae8ee3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.145928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1045/2110] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:21 2022] DELETE /identity/v3/projects/afaa83600aad4f43a4ad88f91df6d4fa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:22.147668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.148118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.148267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.182067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:22.183793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:22.215077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:22.260129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1066/2111] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:22.267993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.268300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.269164 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.294106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:22.295838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:22.310865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1046/2112] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:22.312604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.323471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c1da9-5073-40f8-a829-11d72e5d3cac None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.329880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.330417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.330796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.331677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.332407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:22.332894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.334919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.359701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1067/2113] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:22.361196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.375686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967aea5-80da-48d9-8abd-b66bd0956352 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.385192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.385815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.386116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.386389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.388925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.391586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.421573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1047/2114] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:22.426418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.439685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d7ea-d346-44bc-bae8-4d29ad10afbe admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.520088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.520696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.520970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.521371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.521885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.523808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.549370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1068/2115] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:22.553273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.564706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e78de-8dc0-4a7d-a29c-85c1ef1548b8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.571925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.572767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.573048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.573318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.574758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.577025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.588471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1048/2116] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:22.592718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.606053 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a271-1271-44cc-bd6e-c9dcfef662d2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.614713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbdfc2-562c-4e26-8e8d-6dd527e969fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.615514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbdfc2-562c-4e26-8e8d-6dd527e969fc admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.615890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbdfc2-562c-4e26-8e8d-6dd527e969fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.616292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbdfc2-562c-4e26-8e8d-6dd527e969fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.617192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbdfc2-562c-4e26-8e8d-6dd527e969fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.621075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbdfc2-562c-4e26-8e8d-6dd527e969fc admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.644356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1069/2117] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:22.645556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.660509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983507c8-8ee5-4ebb-8219-c98c2e9f9a17 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.667000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.667843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.668228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.668604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] PATH_INFO: `/v3/projects/24a949f527b842ed9991d9cd940164fa/users/89f6cfaf9c644abab9cda47b84f7a1eb/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.695830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a949f527b842ed9991d9cd940164fa, user_id=89f6cfaf9c644abab9cda47b84f7a1eb, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.699496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.727048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1049/2118] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:22 2022] PUT /identity/v3/projects/24a949f527b842ed9991d9cd940164fa/users/89f6cfaf9c644abab9cda47b84f7a1eb/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:22.730849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780479bc-4e28-4b15-85eb-4c869b91a2e1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.731197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780479bc-4e28-4b15-85eb-4c869b91a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.731374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780479bc-4e28-4b15-85eb-4c869b91a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.769719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-780479bc-4e28-4b15-85eb-4c869b91a2e1 None None] MFA Rules not processed for user `89f6cfaf9c644abab9cda47b84f7a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:22.771267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-780479bc-4e28-4b15-85eb-4c869b91a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:22.913896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1070/2119] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:22.923096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.930802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:23.046770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1483590-85e2-43db-a960-09225100b3ab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.052222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.052945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.053222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.053491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.066499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.068079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.088775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1050/2120] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:24.356770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.358414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.358874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.399228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] MFA Rules not processed for user `435115d080c8427c9d21c93cc058774d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:24.400820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:24.425820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:24.537411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1071/2121] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:24.553524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.556531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:24.652931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05df52d-c023-403a-8560-d6c8d5bdff2d service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.657371 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.658248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.658784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.659232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.661365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:24.736849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:24.797422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.799222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150d163-7f7f-4ac4-8bab-31db27d4c873 service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.822304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1051/2122] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:25.003441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.006554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.030509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acb1cc-fcc6-476c-9c1e-87d1ca0b24e6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.030795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acb1cc-fcc6-476c-9c1e-87d1ca0b24e6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.031235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acb1cc-fcc6-476c-9c1e-87d1ca0b24e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.087541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f9acb1cc-fcc6-476c-9c1e-87d1ca0b24e6 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:25.089474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9435ef-7f25-4ea2-8820-5fac6aa2da9a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.089652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9acb1cc-fcc6-476c-9c1e-87d1ca0b24e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.098303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.100390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.100731 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.101014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] PATH_INFO: `/v3/users/0a751629186549208a6634da941b4529` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.102441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a751629186549208a6634da941b4529)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.104402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.187241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a751629186549208a6634da941b4529'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:25.202468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1052/2123] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:25.209742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a751629186549208a6634da941b4529'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:25.228553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a751629186549208a6634da941b4529'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:25.229659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a751629186549208a6634da941b4529'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:25.241445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a751629186549208a6634da941b4529'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:25.248469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1072/2124] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:25 2022] DELETE /identity/v3/users/0a751629186549208a6634da941b4529 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:25.253270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.253556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.253832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.284465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:25.286885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.287057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.288428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.345593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:25.388352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1053/2125] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:25.390511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e63ee5-56e0-4f05-a08d-56cf6e879ce4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.396746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.397488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.397894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.398277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.399155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.400426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.400962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.483962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d03f2-e026-4461-8e9c-026e9c61b17d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.485613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.487317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.489442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.490367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.490794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.491234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.497480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1073/2126] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:25.515028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.516585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.529771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1054/2127] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:26.127120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:26.129885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:26.153025 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c8a0-e3d8-46ea-b469-b4adb8b1601a service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:26.166897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:26.167225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:26.167746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:26.167746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] PATH_INFO: `/v3/projects/225466640f1c474ea2051f980efd9113` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:26.170024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225466640f1c474ea2051f980efd9113)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:26.171994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:26.266138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225466640f1c474ea2051f980efd9113', 'request_id': 'req-81dc5be2-202f-4c34-be91-8ba73688b463'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.273495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225466640f1c474ea2051f980efd9113', 'request_id': 'req-81dc5be2-202f-4c34-be91-8ba73688b463'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.281331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225466640f1c474ea2051f980efd9113', 'request_id': 'req-81dc5be2-202f-4c34-be91-8ba73688b463'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.299134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] The token cache is being invalidate because project 225466640f1c474ea2051f980efd9113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:26.300214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.300895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-81dc5be2-202f-4c34-be91-8ba73688b463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.302687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1074/2128] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:26 2022] DELETE /identity/v3/projects/225466640f1c474ea2051f980efd9113 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:26.306738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:26.325431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e72d-8550-44c1-a297-e47c7d6a251e service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:26.385025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:26.455446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:26.456645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:26.456943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:26.457201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] PATH_INFO: `/v3/users/ccc7803e3b0a4ab7b6e7497bf90f2d87` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:26.461484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc7803e3b0a4ab7b6e7497bf90f2d87)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:26.463617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:26.593942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc7803e3b0a4ab7b6e7497bf90f2d87'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.595183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc7803e3b0a4ab7b6e7497bf90f2d87'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.596074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc7803e3b0a4ab7b6e7497bf90f2d87'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.622877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc7803e3b0a4ab7b6e7497bf90f2d87'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.630244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:26.631030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:26.631030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:26.649151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc7803e3b0a4ab7b6e7497bf90f2d87'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:26.662070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:26.666280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:26.673701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1055/2129] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:26 2022] DELETE /identity/v3/users/ccc7803e3b0a4ab7b6e7497bf90f2d87 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:26.825200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:26.849554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1075/2130] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:26.875356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:26.877057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:27.024139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebea390-6af1-4332-b435-abbfae9476c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:27.040118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87212e-ed75-41e1-8a6f-340375bb00f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:27.041650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87212e-ed75-41e1-8a6f-340375bb00f3 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.041962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87212e-ed75-41e1-8a6f-340375bb00f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.042283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87212e-ed75-41e1-8a6f-340375bb00f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.136895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:27.139035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:27.187917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61dc13-1ec1-4754-9aad-c40acf87c92c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:27.237652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.261386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87212e-ed75-41e1-8a6f-340375bb00f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:27.264874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87212e-ed75-41e1-8a6f-340375bb00f3 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:27.280504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1056/2131] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:20:27.316200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:27.317309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.318037 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.318502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] PATH_INFO: `/v3/projects/5b03e7721ce442178a2c4719da942066` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.321446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b03e7721ce442178a2c4719da942066)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:27.323996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:27.478534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b03e7721ce442178a2c4719da942066', 'request_id': 'req-7ec74df8-a599-4343-8ce9-13f907531785'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.496040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b03e7721ce442178a2c4719da942066', 'request_id': 'req-7ec74df8-a599-4343-8ce9-13f907531785'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.512513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b03e7721ce442178a2c4719da942066', 'request_id': 'req-7ec74df8-a599-4343-8ce9-13f907531785'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.547341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] The token cache is being invalidate because project 5b03e7721ce442178a2c4719da942066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:27.547341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.549316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7ec74df8-a599-4343-8ce9-13f907531785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.553003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1076/2132] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:27 2022] DELETE /identity/v3/projects/5b03e7721ce442178a2c4719da942066 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:27.557776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.558299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.558520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.594222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:27.597275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:27.753439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1057/2133] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:27.754944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.755476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.755651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.791021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:27.792741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:27.807719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1077/2134] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:27.812424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:27.842510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35b35f-1de8-4dce-bb3a-51b1acef69c7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:27.850224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:27.850840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.853778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.854306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.855137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:27.856121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:27.857952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:27.895425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1058/2135] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:27.896978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:27.908313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99301e9b-9811-418c-ab88-ad2fb29d1345 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:27.913918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:27.914719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.915816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.916246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.917088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:27.920272 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:27.966660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1078/2136] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:27 2022] POST /identity/v3/projects => generated 407 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:27.970603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:27.990544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865f22-cf7e-48c0-9a8c-71cb84feeb85 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.114874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.115621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.115903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.116238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.117009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:28.129033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:28.193613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:28.195611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1059/2137] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:27 2022] POST /identity/v3/users => generated 304 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:28.218178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed72ea-2306-4a0b-b6cb-96e66d1142cb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.231201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.233181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.233686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.234371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.235256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:28.238486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:28.255085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1079/2138] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:28.258697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:28.274987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451057c-89c5-4668-bf0e-7ce8f7ecb41c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.282441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff026-c8ab-4ca9-bb25-a00baccba78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.283058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff026-c8ab-4ca9-bb25-a00baccba78c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.283850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff026-c8ab-4ca9-bb25-a00baccba78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.284156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff026-c8ab-4ca9-bb25-a00baccba78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.285036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff026-c8ab-4ca9-bb25-a00baccba78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:28.287766 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff026-c8ab-4ca9-bb25-a00baccba78c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:28.303577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1060/2139] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:28.304868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:28.323060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503ce7-4eed-42d6-944e-bfc14b0659f2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.342764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82cd94-dc5c-4e52-9a09-6515a50a4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.343440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cd94-dc5c-4e52-9a09-6515a50a4ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.343724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cd94-dc5c-4e52-9a09-6515a50a4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.344000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cd94-dc5c-4e52-9a09-6515a50a4ab6 admin admin] PATH_INFO: `/v3/projects/7da5586787744ea18619b58ad1e0e099/users/f33986261752497c9fd1901425f97ddb/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.352564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.353387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.353387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.384465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:28.385712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:28.388981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cd94-dc5c-4e52-9a09-6515a50a4ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da5586787744ea18619b58ad1e0e099, user_id=f33986261752497c9fd1901425f97ddb, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:28.391687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cd94-dc5c-4e52-9a09-6515a50a4ab6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:28.424404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1080/2140] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:28 2022] PUT /identity/v3/projects/7da5586787744ea18619b58ad1e0e099/users/f33986261752497c9fd1901425f97ddb/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:28.435670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.435932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.436208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.491751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] MFA Rules not processed for user `f33986261752497c9fd1901425f97ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:28.493532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:28.519368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:28.524205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:28.550024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1061/2141] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 00:20:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:28.568305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:28.570044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:28.633633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1081/2142] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:28 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:28.634913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:28.764126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe2f2-1bfa-488b-8cb7-db9016d38680 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.786330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eee480-7634-4daa-ab7e-b4b3f56ce2b4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.802870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.804555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.805088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.805583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.806597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:28.809507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:28.892611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.894447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.894733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.895010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.900004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1082/2143] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:28 2022] POST /identity/v3/projects => generated 407 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:28.911744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:29.036234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d0446-8713-4926-8a62-194658ab0aa0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:29.042566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:29.043192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.043477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.043755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.044432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:29.044785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:29.046609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:29.046931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:29.063797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1062/2144] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:29.101214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1083/2145] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:28 2022] POST /identity/v3/users => generated 310 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:29.102405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:29.121890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a6e4-f6cf-43dd-8701-98094db18174 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:29.151225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:29.151852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.152160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.152413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.153074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:29.154722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:29.181526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1063/2146] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:29.181649 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:29.200218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3d159-a321-4f5c-9790-7e01a8efe22e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:29.212177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:29.213377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.213781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.214175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] PATH_INFO: `/v3/projects/f787ed1c2e7d43369e6f4f42484a4816/users/b0a4040472ee4db197de0e8456b8e9c1/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.238132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f787ed1c2e7d43369e6f4f42484a4816, user_id=b0a4040472ee4db197de0e8456b8e9c1, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:29.241412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:29.295980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1084/2147] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:29 2022] PUT /identity/v3/projects/f787ed1c2e7d43369e6f4f42484a4816/users/b0a4040472ee4db197de0e8456b8e9c1/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:29.302034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:29.328569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237d5c-cba1-4700-8625-715df62daf8d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:29.435988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:29.489928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93367bbd-64d4-4d9a-ab4f-870876769c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:29.490554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367bbd-64d4-4d9a-ab4f-870876769c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.490835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367bbd-64d4-4d9a-ab4f-870876769c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.491112 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367bbd-64d4-4d9a-ab4f-870876769c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.491788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93367bbd-64d4-4d9a-ab4f-870876769c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:29.493404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93367bbd-64d4-4d9a-ab4f-870876769c50 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:29.525474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1064/2148] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:29.526663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:29.537574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:29.551591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d575-2b0b-4c34-85eb-80daa8491b08 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:29.571459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a4936-2010-4d0a-9f7d-027e69251641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:29.572150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a4936-2010-4d0a-9f7d-027e69251641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.574689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a4936-2010-4d0a-9f7d-027e69251641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.575002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a4936-2010-4d0a-9f7d-027e69251641 admin admin] PATH_INFO: `/v3/projects/f787ed1c2e7d43369e6f4f42484a4816/users/b0a4040472ee4db197de0e8456b8e9c1/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.580897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a4936-2010-4d0a-9f7d-027e69251641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f787ed1c2e7d43369e6f4f42484a4816, user_id=b0a4040472ee4db197de0e8456b8e9c1, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:29.588874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a4936-2010-4d0a-9f7d-027e69251641 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:29.610770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.611662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.612667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.614676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1085/2149] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:29 2022] PUT /identity/v3/projects/f787ed1c2e7d43369e6f4f42484a4816/users/b0a4040472ee4db197de0e8456b8e9c1/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:29.626138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.626449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.626744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.667199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:29.674028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:29.700724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] MFA Rules not processed for user `b0a4040472ee4db197de0e8456b8e9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:29.702330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:29.831456 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1065/2150] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:29.836527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1086/2151] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:29 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:29.847015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:29.848975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:29.853784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:30.020447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801c724-6627-4022-b2a9-cbe9cc849874 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:30.030018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7fc2d-0598-4504-bb99-9b1e473bde84 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:30.034846 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:30.035263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ddad2-8cd3-4276-a796-06507398a09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:30.035607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:30.035970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:30.036304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:30.036532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ddad2-8cd3-4276-a796-06507398a09d service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:30.036963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ddad2-8cd3-4276-a796-06507398a09d service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:30.037384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ddad2-8cd3-4276-a796-06507398a09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:30.053138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:30.056068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:30.057984 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ddad2-8cd3-4276-a796-06507398a09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:30.061610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ddad2-8cd3-4276-a796-06507398a09d service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:30.075351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1087/2152] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:30.080260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1066/2153] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:29 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:30.356720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:30.379445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7f00-ab31-4398-9b08-8f4b1f297aba service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:30.401338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:30.403644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:30.406344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:30.407765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:30.642047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:30.646009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:30.671187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1088/2154] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:30 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:31.235647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.236182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.236182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.286848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:31.300396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.312259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1067/2155] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 00:20:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:31.369678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:31.378799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:31.387248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185ecd-6c0b-498e-ac67-16994108c11d service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:31.424859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:31.425507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.425786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.426127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.443533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:31.445598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:31.502541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1089/2156] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:34.045797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:34.051350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:34.140010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821aeb-02af-45e8-8ea5-3c259b60d467 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:34.144578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:34.145219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.145492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.145760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] PATH_INFO: `/v3/users/ced4ad031f324edb89eff6133fbf9543` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.146918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced4ad031f324edb89eff6133fbf9543)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:34.149045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:34.165912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:34.213428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced4ad031f324edb89eff6133fbf9543'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.214253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced4ad031f324edb89eff6133fbf9543'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.215003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced4ad031f324edb89eff6133fbf9543'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.230591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced4ad031f324edb89eff6133fbf9543'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.239844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b67b6182-da9a-41de-95d1-8da03d0edf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced4ad031f324edb89eff6133fbf9543'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.257084 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1068/2157] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:34 2022] DELETE /identity/v3/users/ced4ad031f324edb89eff6133fbf9543 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:34.453094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:34.469122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22be92-e0e0-4365-9302-b3b8f411fcf5 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:34.550783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:34.553160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.553513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.553871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] PATH_INFO: `/v3/projects/258e6d65abf74a58af993ca946d98798` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.555876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258e6d65abf74a58af993ca946d98798)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:34.559083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:34.636303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258e6d65abf74a58af993ca946d98798', 'request_id': 'req-d59301ad-9701-4063-9c41-c36ede4b3458'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.644175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258e6d65abf74a58af993ca946d98798', 'request_id': 'req-d59301ad-9701-4063-9c41-c36ede4b3458'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.650671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258e6d65abf74a58af993ca946d98798', 'request_id': 'req-d59301ad-9701-4063-9c41-c36ede4b3458'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.665882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] The token cache is being invalidate because project 258e6d65abf74a58af993ca946d98798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:34.666175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.666813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d59301ad-9701-4063-9c41-c36ede4b3458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.668284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1090/2158] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:34 2022] DELETE /identity/v3/projects/258e6d65abf74a58af993ca946d98798 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:34.673575 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.673891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.674211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.697613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:34.698898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:34.767185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1069/2159] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:34.775519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.775869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.776150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.798661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:34.798661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:34.807297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1091/2160] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:34.811574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:34.823889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f391-310e-4af6-862a-59371de74e8c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:34.829115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:34.829825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.830773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.831153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.831967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:34.832373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:34.834121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:34.848452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1070/2161] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:20:34.852850 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:34.875228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e071c86-0f18-4f4b-81f7-e47c6d44a299 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:34.880386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:34.880999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.881278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.881551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.882215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:34.884279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:34.934232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1092/2162] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:34 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:34.935341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:34.951823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7d56-c1e3-4279-b95c-0f509a4c2409 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.035613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.036316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.036602 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.036873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.037517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.039546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.072655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1071/2163] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:34 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:35.076749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:35.087979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02091439-6d9c-4d68-b746-8d8816d8f518 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.092713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.093312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.093591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.093912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.094562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.096716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.108964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1093/2164] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:35.113399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:35.124909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6eb98-9e2a-4841-ab72-ef176e48344e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.129709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf50ff6-3b2b-451a-8608-dc2a740f76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.130346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf50ff6-3b2b-451a-8608-dc2a740f76f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.130627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf50ff6-3b2b-451a-8608-dc2a740f76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.130899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf50ff6-3b2b-451a-8608-dc2a740f76f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.131691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf50ff6-3b2b-451a-8608-dc2a740f76f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.133302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf50ff6-3b2b-451a-8608-dc2a740f76f8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.134752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:35.155840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:35.161319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1072/2165] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:35.166725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6ed9b-4e8c-4b54-8e81-d3b9ee7a3e63 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.171787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.173063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.173063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.173063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] PATH_INFO: `/v3/projects/a6a04d28f69a48efb5e2c3a3c1b4458a/users/d519df0c72d14da9a735a450f492b947/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.188796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a04d28f69a48efb5e2c3a3c1b4458a, user_id=d519df0c72d14da9a735a450f492b947, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.192787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.207033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1094/2166] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:35 2022] PUT /identity/v3/projects/a6a04d28f69a48efb5e2c3a3c1b4458a/users/d519df0c72d14da9a735a450f492b947/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:35.217570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c81f-f5e3-4a4a-873a-28094f4a84a9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.217961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c81f-f5e3-4a4a-873a-28094f4a84a9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.218342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c81f-f5e3-4a4a-873a-28094f4a84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.250145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7151c81f-f5e3-4a4a-873a-28094f4a84a9 None None] MFA Rules not processed for user `d519df0c72d14da9a735a450f492b947`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:35.251560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7151c81f-f5e3-4a4a-873a-28094f4a84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:35.329631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1073/2167] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:35.341898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:35.343951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:35.371524 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:35.435256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a33f9-e817-4949-8f84-c2c39950e12f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.443758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.444460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.444746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.445017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.457403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.459069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.468950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1095/2168] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:39.265364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f38f-ad37-4101-8641-d03a2bc68c6d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:39.265908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f38f-ad37-4101-8641-d03a2bc68c6d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:39.266001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f38f-ad37-4101-8641-d03a2bc68c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:39.284320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-aa44f38f-ad37-4101-8641-d03a2bc68c6d None None] MFA Rules not processed for user `cdd2a01bf81d406e877a1c4ace635704`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:39.285508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa44f38f-ad37-4101-8641-d03a2bc68c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:39.338698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1074/2169] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:39.925738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:39.927513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.002114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8ccfa-5cf4-4408-adda-f4e4ae4fd12c service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.007367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.008030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.008311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.008615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] PATH_INFO: `/v3/users/efd87db4f6344050b39048acdd3cdd56` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.009811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd87db4f6344050b39048acdd3cdd56)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.011709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.058785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd87db4f6344050b39048acdd3cdd56'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.066558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd87db4f6344050b39048acdd3cdd56'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.083758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd87db4f6344050b39048acdd3cdd56'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.084558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd87db4f6344050b39048acdd3cdd56'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.094342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd87db4f6344050b39048acdd3cdd56'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.103658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1096/2170] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:39 2022] DELETE /identity/v3/users/efd87db4f6344050b39048acdd3cdd56 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:40.109630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.110016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.110361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.134651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.136132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.206121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1075/2171] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:40.214143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:40.216131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.249445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:40.304080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeb023-8d03-42b3-8d63-79e59e914965 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.309204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fa35a-1166-4980-b76e-4e6a6784f167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.310201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fa35a-1166-4980-b76e-4e6a6784f167 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.310531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fa35a-1166-4980-b76e-4e6a6784f167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.310917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fa35a-1166-4980-b76e-4e6a6784f167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.343611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fa35a-1166-4980-b76e-4e6a6784f167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.345806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fa35a-1166-4980-b76e-4e6a6784f167 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.373651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1097/2172] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:40.570566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:40.572107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.584926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174974b-6faa-4d3f-91c9-3f8115ed76fd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.590272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.590905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.591178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.591590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] PATH_INFO: `/v3/projects/9f15ffcbae924b52830ebc980091bf40` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.592826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f15ffcbae924b52830ebc980091bf40)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.594822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.632010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:40.651751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f15ffcbae924b52830ebc980091bf40', 'request_id': 'req-4ab11320-c539-48f0-8362-21ea3faa3725'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.658230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f15ffcbae924b52830ebc980091bf40', 'request_id': 'req-4ab11320-c539-48f0-8362-21ea3faa3725'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.665664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f15ffcbae924b52830ebc980091bf40', 'request_id': 'req-4ab11320-c539-48f0-8362-21ea3faa3725'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.679483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] The token cache is being invalidate because project 9f15ffcbae924b52830ebc980091bf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:40.679777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.680552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ab11320-c539-48f0-8362-21ea3faa3725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.682296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1076/2173] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:40 2022] DELETE /identity/v3/projects/9f15ffcbae924b52830ebc980091bf40 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:40.687074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49543515-0a78-4242-a987-1db725e00e38 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.687426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49543515-0a78-4242-a987-1db725e00e38 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.687765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49543515-0a78-4242-a987-1db725e00e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.707960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-49543515-0a78-4242-a987-1db725e00e38 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.709145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-49543515-0a78-4242-a987-1db725e00e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.767177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1098/2174] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:40.776046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.776347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.776635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.797146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.798729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.806686 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1077/2175] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:40.810859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49543515-0a78-4242-a987-1db725e00e38 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:40.820657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49543515-0a78-4242-a987-1db725e00e38 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.825370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.825999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.826284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.826675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.827381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:40.827718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.829319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.841785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1099/2176] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:20:40.847405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:40.856928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465bcf7-bcf5-4cfc-b866-71417a76a208 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.861779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.862451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.862694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.862967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.863635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.865533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.894957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1078/2177] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:40.899223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:40.910729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9018f-e83b-4c5f-beef-f8399cf7c07b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.997475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.999195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.999618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.000001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.000842 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.003950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.035776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1100/2178] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:41.036924 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.057504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b495-5827-4a07-9ad0-ecf090c89827 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.064035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.065305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.065680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.066121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.066923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.068699 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.085454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.091362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1079/2179] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:41.116090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f29119-cf30-46e2-9acb-6c28b918dfd8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.123012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce41a-a86a-4d43-b333-a50177c97c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.124084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce41a-a86a-4d43-b333-a50177c97c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.124521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce41a-a86a-4d43-b333-a50177c97c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.125034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce41a-a86a-4d43-b333-a50177c97c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.128883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcce41a-a86a-4d43-b333-a50177c97c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.131491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcce41a-a86a-4d43-b333-a50177c97c3d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.147679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1101/2180] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:41.158852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.172488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95ab9-d4bb-49e3-ba6e-55477391f5bd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.177957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.179005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.179223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.179660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] PATH_INFO: `/v3/projects/80dbc22f8641481291939540b00e0225/users/4e57290be8d341db824952c83703b118/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.200091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80dbc22f8641481291939540b00e0225, user_id=4e57290be8d341db824952c83703b118, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.203178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.221324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1080/2181] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:41 2022] PUT /identity/v3/projects/80dbc22f8641481291939540b00e0225/users/4e57290be8d341db824952c83703b118/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:41.228539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.228826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.229103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.253273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:41.254646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:41.288710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:41.339003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1102/2182] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:41.349626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.351804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:41.436220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3866997-c004-44a1-85ed-89b3ecd6e864 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.440692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814ca9-8246-4ab4-ab28-5ad790ea4c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.441675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814ca9-8246-4ab4-ab28-5ad790ea4c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.442055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814ca9-8246-4ab4-ab28-5ad790ea4c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.442524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814ca9-8246-4ab4-ab28-5ad790ea4c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.453196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e814ca9-8246-4ab4-ab28-5ad790ea4c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.455175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e814ca9-8246-4ab4-ab28-5ad790ea4c33 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.465174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1081/2183] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:41.683983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.685459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:41.708279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161239a-6c09-44d6-979c-dcf2649b873d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.720568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.721900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.722167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.722444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] PATH_INFO: `/v3/users/d519df0c72d14da9a735a450f492b947` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.725058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d519df0c72d14da9a735a450f492b947)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.727261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.837017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd519df0c72d14da9a735a450f492b947'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:41.847835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd519df0c72d14da9a735a450f492b947'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:41.892276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd519df0c72d14da9a735a450f492b947'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:41.897565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd519df0c72d14da9a735a450f492b947'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:41.915853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd519df0c72d14da9a735a450f492b947'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:41.948609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1103/2184] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:41 2022] DELETE /identity/v3/users/d519df0c72d14da9a735a450f492b947 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:41.950693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6cad5-14a7-4de1-b3b1-052cca669870 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.951163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6cad5-14a7-4de1-b3b1-052cca669870 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.951257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6cad5-14a7-4de1-b3b1-052cca669870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.976841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c8b6cad5-14a7-4de1-b3b1-052cca669870 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:41.978269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c8b6cad5-14a7-4de1-b3b1-052cca669870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.042245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:42.060967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1082/2185] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.073137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.074874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.146596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d498e21-d82b-4086-8eb8-c8530b807b8c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.152446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.153156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.153965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.154250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.165827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.167430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.191839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1104/2186] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:42.428024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.428531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.428808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.461683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] MFA Rules not processed for user `4e57290be8d341db824952c83703b118`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.463114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.543953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.551439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.579976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1083/2187] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.594248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.597096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.600498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a7674-7155-4c7c-93f0-3d0b3ab80b94 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.630600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.632315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.632315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.632315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] PATH_INFO: `/v3/projects/a6a04d28f69a48efb5e2c3a3c1b4458a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.634521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a04d28f69a48efb5e2c3a3c1b4458a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.636622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.670765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf8232-9f2f-495c-95c0-e2554fa75d61 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.674814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907371c-0cee-4d4a-9681-572bc607fa76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.675608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907371c-0cee-4d4a-9681-572bc607fa76 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.675885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907371c-0cee-4d4a-9681-572bc607fa76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.676283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907371c-0cee-4d4a-9681-572bc607fa76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.685811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907371c-0cee-4d4a-9681-572bc607fa76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.687772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907371c-0cee-4d4a-9681-572bc607fa76 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.698617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1084/2188] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:20:42.699842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.700246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.700354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.703905 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:42.713063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a04d28f69a48efb5e2c3a3c1b4458a', 'request_id': 'req-b613b01c-9ccc-42ab-a9a4-91330deb7488'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.723152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.724460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.725812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a04d28f69a48efb5e2c3a3c1b4458a', 'request_id': 'req-b613b01c-9ccc-42ab-a9a4-91330deb7488'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.734540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a04d28f69a48efb5e2c3a3c1b4458a', 'request_id': 'req-b613b01c-9ccc-42ab-a9a4-91330deb7488'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.756434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] The token cache is being invalidate because project a6a04d28f69a48efb5e2c3a3c1b4458a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:42.757703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.758681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b613b01c-9ccc-42ab-a9a4-91330deb7488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.760966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1105/2189] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:42 2022] DELETE /identity/v3/projects/a6a04d28f69a48efb5e2c3a3c1b4458a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:42.765534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab534-4669-415c-a5f2-639299a2bca5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.765818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab534-4669-415c-a5f2-639299a2bca5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.768361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab534-4669-415c-a5f2-639299a2bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.788849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dbfab534-4669-415c-a5f2-639299a2bca5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.790086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dbfab534-4669-415c-a5f2-639299a2bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.814787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1085/2190] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.842382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.848336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.885390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1106/2191] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.896424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.899191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.900383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.965415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.967048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.985973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:42.987563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1107/2192] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:42.992545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.008692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c766b3-24c4-44b4-bc3d-3b9dabcb7d5e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.021317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.022232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.023353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.024542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.025396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:43.026434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.028813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.054121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112510f-1602-42ad-bec7-461668d3e356 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.056711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1108/2193] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:43.063029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.071397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.072823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.073384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.073928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.086952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f910-1036-497e-8dcf-3f05112f1786 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.094779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.101868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.107125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.107957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.108301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.108749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.110172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.112541 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.127333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1086/2194] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:20:43.195282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1109/2195] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:43.199624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.221773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973979-b3b5-4a36-9c00-6cd245495a86 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.336029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.338432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.338829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.339966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.340642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.344144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.391636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1087/2196] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/users => generated 279 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:43.399048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.422458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156f94d-c28f-4ee3-9eb1-f7a4e245ec98 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.443803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.444809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.445439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.447144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.450067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.457321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.499729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1110/2197] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:43.504982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.523944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12de7-2220-4d9f-b280-974d68a68d4a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.538628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cc4ba-a027-4189-b9ca-d8c4ec696d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.539254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cc4ba-a027-4189-b9ca-d8c4ec696d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.539532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cc4ba-a027-4189-b9ca-d8c4ec696d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.542777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cc4ba-a027-4189-b9ca-d8c4ec696d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.546453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cc4ba-a027-4189-b9ca-d8c4ec696d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.554202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cc4ba-a027-4189-b9ca-d8c4ec696d5b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.613942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1088/2198] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:43.618042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.640073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985994e-10a8-4b94-a530-1496fa6caeda admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.647726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.648806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.649253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.650391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] PATH_INFO: `/v3/projects/ca67c3671f6846cea3ace73809b81ef7/users/f814d264baf0438da5f7b0f81b20422f/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.677167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca67c3671f6846cea3ace73809b81ef7, user_id=f814d264baf0438da5f7b0f81b20422f, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.680292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.698240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1111/2199] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:43 2022] PUT /identity/v3/projects/ca67c3671f6846cea3ace73809b81ef7/users/f814d264baf0438da5f7b0f81b20422f/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:43.709943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.710266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.710548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.793358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] MFA Rules not processed for user `f814d264baf0438da5f7b0f81b20422f`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:43.794935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:43.958059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1089/2200] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:43.983367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.055988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.069149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea44a64-788f-4812-a4d6-30c51352105c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.074158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.075196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.075196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.075355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.076012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.079180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.129892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1112/2201] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/projects => generated 355 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:44.132644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.145208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d606230-396b-4d3c-96d5-c59888f1dbcd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.183011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.244500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.245381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.245782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.246390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.247198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.249618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.285507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1090/2202] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:44.289513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.304974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7724c0-ef75-493f-9532-db0c5519d584 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.310875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.312805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.313164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.313530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.315553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.318237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.331598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1113/2203] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:44.335584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.358419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772aa0-3ac4-464c-952a-49aa1101ad7a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.364536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.366339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.368104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9ed77-3fc6-4d8c-8aae-65ccffb9dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.368850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9ed77-3fc6-4d8c-8aae-65ccffb9dbbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.369124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9ed77-3fc6-4d8c-8aae-65ccffb9dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.371296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9ed77-3fc6-4d8c-8aae-65ccffb9dbbe admin admin] PATH_INFO: `/v3/projects/8bf9070b9b184fc0953081fdfe5ccea1/users/71691b500d2d4820af0908ace58da670/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.379872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c883cb-09df-4a56-b61e-167a452d32be admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.385482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.386428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.386854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.387276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] PATH_INFO: `/v3/users/f33986261752497c9fd1901425f97ddb` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.388637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33986261752497c9fd1901425f97ddb)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.390621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.396088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9ed77-3fc6-4d8c-8aae-65ccffb9dbbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9070b9b184fc0953081fdfe5ccea1, user_id=71691b500d2d4820af0908ace58da670, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.398851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9ed77-3fc6-4d8c-8aae-65ccffb9dbbe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.421153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1091/2204] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:44 2022] PUT /identity/v3/projects/8bf9070b9b184fc0953081fdfe5ccea1/users/71691b500d2d4820af0908ace58da670/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:44.425398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25644f9f-d793-4f0b-82cc-8a0b4de43d9d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.425398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25644f9f-d793-4f0b-82cc-8a0b4de43d9d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.425398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25644f9f-d793-4f0b-82cc-8a0b4de43d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.456238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33986261752497c9fd1901425f97ddb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:44.458118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-25644f9f-d793-4f0b-82cc-8a0b4de43d9d None None] MFA Rules not processed for user `4e57290be8d341db824952c83703b118`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.460068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-25644f9f-d793-4f0b-82cc-8a0b4de43d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.472240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33986261752497c9fd1901425f97ddb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:44.489388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33986261752497c9fd1901425f97ddb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:44.490443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33986261752497c9fd1901425f97ddb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:44.499022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33986261752497c9fd1901425f97ddb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:44.506835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1114/2205] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:44 2022] DELETE /identity/v3/users/f33986261752497c9fd1901425f97ddb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:44.508219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.509749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.566937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1092/2206] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.568629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.568629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.568931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.608824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.611942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.629876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0d17d-705c-4176-8aa9-35c5cda0b4be admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.634791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.635407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.635686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.635959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.636754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.638726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.650522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1115/2207] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:44.654525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.673129 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b1911-073d-43b0-85ec-f65cdbddffa1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.708019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ead66e-f66c-4e69-91ad-bbf6e1089e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.708701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ead66e-f66c-4e69-91ad-bbf6e1089e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.708980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ead66e-f66c-4e69-91ad-bbf6e1089e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.709254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ead66e-f66c-4e69-91ad-bbf6e1089e28 admin admin] PATH_INFO: `/v3/projects/8bf9070b9b184fc0953081fdfe5ccea1/users/71691b500d2d4820af0908ace58da670/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.712976 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1093/2208] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.719454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ead66e-f66c-4e69-91ad-bbf6e1089e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9070b9b184fc0953081fdfe5ccea1, user_id=71691b500d2d4820af0908ace58da670, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.724000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.725373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.726538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ead66e-f66c-4e69-91ad-bbf6e1089e28 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.741376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1116/2209] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:44 2022] PUT /identity/v3/projects/8bf9070b9b184fc0953081fdfe5ccea1/users/71691b500d2d4820af0908ace58da670/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:44.755693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.755869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.756148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.801894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] MFA Rules not processed for user `71691b500d2d4820af0908ace58da670`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.804265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.817056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.821725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.849118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2fb6-4683-4973-8286-12dffd1f3079 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.914656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.915814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.916095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.916369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.921574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1117/2210] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.937548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.941359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.043359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.045101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.060401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1094/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:20:45.068067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21ce5-c9ea-4864-8cc3-06b23070d6da None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.080676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.081332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.081615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.081904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.119858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.121756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.153263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1118/2212] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:45.265877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.279683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83edfd7-f0f3-43a5-bcc0-bc286fcddf89 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.292210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.293012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.293306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.293595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.297762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.410617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.412226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.437058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1095/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:45.606454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.608382 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.648446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ed06-acbb-480c-b20c-beb4ba03159e service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.655970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.656629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.656915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.657192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] PATH_INFO: `/v3/projects/7da5586787744ea18619b58ad1e0e099` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.659374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da5586787744ea18619b58ad1e0e099)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.666113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.800852 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da5586787744ea18619b58ad1e0e099', 'request_id': 'req-50d42fad-1865-40e7-9e23-57af202867c4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:45.812319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da5586787744ea18619b58ad1e0e099', 'request_id': 'req-50d42fad-1865-40e7-9e23-57af202867c4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:45.835752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da5586787744ea18619b58ad1e0e099', 'request_id': 'req-50d42fad-1865-40e7-9e23-57af202867c4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:45.863926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] The token cache is being invalidate because project 7da5586787744ea18619b58ad1e0e099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:45.864273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:45.865125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:45.871875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1119/2214] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:45 2022] DELETE /identity/v3/projects/7da5586787744ea18619b58ad1e0e099 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:45.874096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.890280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89f277-fc11-4af5-ac29-d25db0f6ffe9 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.000905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.024519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.025341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.025826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.026230 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] PATH_INFO: `/v3/users/b0a4040472ee4db197de0e8456b8e9c1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.027803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a4040472ee4db197de0e8456b8e9c1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.030028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.149805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a4040472ee4db197de0e8456b8e9c1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:46.150616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a4040472ee4db197de0e8456b8e9c1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:46.151931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a4040472ee4db197de0e8456b8e9c1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:46.168878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a4040472ee4db197de0e8456b8e9c1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:46.182863 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04423667-cad8-43b0-8362-a54931bfa109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a4040472ee4db197de0e8456b8e9c1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:46.212070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1096/2215] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:45 2022] DELETE /identity/v3/users/b0a4040472ee4db197de0e8456b8e9c1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.741270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.743439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:46.760936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d42fad-1865-40e7-9e23-57af202867c4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.805162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.858710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.859785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.860095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.862812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] PATH_INFO: `/v3/projects/f787ed1c2e7d43369e6f4f42484a4816` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.865884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f787ed1c2e7d43369e6f4f42484a4816)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.867864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.981489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f787ed1c2e7d43369e6f4f42484a4816', 'request_id': 'req-bee754eb-cc8c-4caf-8167-80072b2ddf12'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:46.992851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f787ed1c2e7d43369e6f4f42484a4816', 'request_id': 'req-bee754eb-cc8c-4caf-8167-80072b2ddf12'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:47.019742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f787ed1c2e7d43369e6f4f42484a4816', 'request_id': 'req-bee754eb-cc8c-4caf-8167-80072b2ddf12'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:47.052219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] The token cache is being invalidate because project f787ed1c2e7d43369e6f4f42484a4816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:47.052560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:47.053393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bee754eb-cc8c-4caf-8167-80072b2ddf12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:47.057947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1120/2216] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:46 2022] DELETE /identity/v3/projects/f787ed1c2e7d43369e6f4f42484a4816 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:47.063091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.063720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.063720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.119105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.120667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.231568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1097/2217] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.241112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.241397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.241673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.267337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.268132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.286992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1121/2218] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.291940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.303556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd7d6-76ce-48e3-8c99-2f1f5a68050c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.308325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.308930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.309203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.309472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.310770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:47.311071 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.312701 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.334005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1098/2219] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:47.338417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.352533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aec4c2-4f06-40dc-955b-ad371c8f7193 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.357431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.358157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.358523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.358867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.359588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.362203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.411232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1122/2220] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:47.415778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.427706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38314b-3a58-4f82-a322-f16936c85714 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.485926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:47.503155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.503972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.504409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.504844 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.505630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.507753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.536386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1099/2221] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:47.537969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.549161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31a98-a001-4aea-aaa4-de8c419f6aab admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.554182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.554791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.555066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.555343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.555989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.557629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.568572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1123/2222] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:47.573087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.583352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b79fe6-7b53-4d1e-a142-12ac7b0552dc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.588040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8124b-dd3c-418d-a22e-1c8ca1f2663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.588644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8124b-dd3c-418d-a22e-1c8ca1f2663a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.588920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8124b-dd3c-418d-a22e-1c8ca1f2663a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.589191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8124b-dd3c-418d-a22e-1c8ca1f2663a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.589874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8124b-dd3c-418d-a22e-1c8ca1f2663a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.591500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8124b-dd3c-418d-a22e-1c8ca1f2663a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.605060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1100/2223] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:47.610603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.621448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61764d-9d0d-4686-90fa-beae82b661a4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.626065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.626716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.627368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.627368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] PATH_INFO: `/v3/projects/084c7856274f482785089444982c5969/users/e8e5a2450ba746008c4c4a7003007923/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.643152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084c7856274f482785089444982c5969, user_id=e8e5a2450ba746008c4c4a7003007923, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.647101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.666337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1124/2224] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:47 2022] PUT /identity/v3/projects/084c7856274f482785089444982c5969/users/e8e5a2450ba746008c4c4a7003007923/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:47.671330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d666c-a1b8-411e-8429-429b98969be5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.671868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d666c-a1b8-411e-8429-429b98969be5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.672347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d666c-a1b8-411e-8429-429b98969be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.696159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-457d666c-a1b8-411e-8429-429b98969be5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.697390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-457d666c-a1b8-411e-8429-429b98969be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.774419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1101/2225] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.787697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.789681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.881635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779c579-cd8a-4572-b533-808bdc786434 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.885340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.885980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.886258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.886553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.896487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.897958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.913274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1125/2226] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:48.916370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.916957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.917792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.958482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] MFA Rules not processed for user `e8e5a2450ba746008c4c4a7003007923`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:48.960148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:49.062941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1102/2227] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:49.067737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.073271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:49.079556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9eaa-9c05-43f5-8b38-e20ec264f836 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.087156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.088383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.088924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.089386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.090378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.093059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.145938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1126/2228] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:49 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:49.148182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.159702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76f86-a1aa-4e24-9964-147774a3497a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.223093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.223707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.223988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.224261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.224902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.227062 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.235978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:49.258856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1103/2229] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:49 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:49.263581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.277947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8969cc-0b17-4a22-be28-e24008081665 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.284531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.285497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.286101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.286582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.287680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.289570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.303051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1127/2230] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:49.308198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.319451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368297f-f476-4b96-8951-876a54bb9082 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.324512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.325872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.326177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.326454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] PATH_INFO: `/v3/projects/153f3756e28b479bb31468711bef665e/users/5856fcedb84745f29bcb701066dbfc28/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.342561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153f3756e28b479bb31468711bef665e, user_id=5856fcedb84745f29bcb701066dbfc28, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.345394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.359609 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1104/2231] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:49 2022] PUT /identity/v3/projects/153f3756e28b479bb31468711bef665e/users/5856fcedb84745f29bcb701066dbfc28/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:49.363714 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.374077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c49bde-5adf-4f51-8cf2-2be65d26d437 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.437550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66e3e-f223-4df5-a9c6-2dc8eb63f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.438314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66e3e-f223-4df5-a9c6-2dc8eb63f394 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.438591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66e3e-f223-4df5-a9c6-2dc8eb63f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.438860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66e3e-f223-4df5-a9c6-2dc8eb63f394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.439529 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66e3e-f223-4df5-a9c6-2dc8eb63f394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.441138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66e3e-f223-4df5-a9c6-2dc8eb63f394 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.451631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1128/2232] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:49.455953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.466451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ca8c-491c-49a2-a507-5cc7c1f2ba09 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.471982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.472720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.473047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.473383 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] PATH_INFO: `/v3/projects/153f3756e28b479bb31468711bef665e/users/5856fcedb84745f29bcb701066dbfc28/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.475424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=153f3756e28b479bb31468711bef665e, user_id=5856fcedb84745f29bcb701066dbfc28, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.478262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.493013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1105/2233] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:49 2022] PUT /identity/v3/projects/153f3756e28b479bb31468711bef665e/users/5856fcedb84745f29bcb701066dbfc28/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:50.404981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:50.405450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:50.405450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:50.505596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] MFA Rules not processed for user `5856fcedb84745f29bcb701066dbfc28`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:50.507215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:50.637306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1129/2234] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:20:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:50.644740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:50.646300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:50.714589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca7b4-36c5-44ad-83de-1aa6b6f8ef2c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:50.720899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:50.721558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:50.721831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:50.722136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:50.790409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:50.791324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:50.801936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1106/2235] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:52.230443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.241087 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f3dac-fae9-414a-855c-e74fc1984091 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.244757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd396e-a45b-433e-a19c-3bbaf62dca22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.245389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd396e-a45b-433e-a19c-3bbaf62dca22 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.245668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd396e-a45b-433e-a19c-3bbaf62dca22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.246252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd396e-a45b-433e-a19c-3bbaf62dca22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.256342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd396e-a45b-433e-a19c-3bbaf62dca22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.257783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd396e-a45b-433e-a19c-3bbaf62dca22 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.268381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1130/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:00.796630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=5,keystone:SELECT=65 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:02.263420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:02.844179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:02.845763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.914353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a15918-46e5-42c9-9e33-9fe8ae5cb0fa service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:02.919063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:02.919633 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.920049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.920211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] PATH_INFO: `/v3/users/f814d264baf0438da5f7b0f81b20422f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.921369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f814d264baf0438da5f7b0f81b20422f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:02.923618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:02.972555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f814d264baf0438da5f7b0f81b20422f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.973212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f814d264baf0438da5f7b0f81b20422f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.973805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f814d264baf0438da5f7b0f81b20422f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.986255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f814d264baf0438da5f7b0f81b20422f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.993943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f814d264baf0438da5f7b0f81b20422f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.006975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1107/2237] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:02 2022] DELETE /identity/v3/users/f814d264baf0438da5f7b0f81b20422f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:03.011384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.011664 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.011934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.031768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.033008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.094910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1131/2238] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:03.104731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.106220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.165914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b858f-fce0-43a4-9579-3951ba8daec1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.170161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.170688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.170961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.171226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.181828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.183266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.193736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1108/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:03.464865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.466424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.481446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f7faa-1f7e-4667-bbf9-5001d729e950 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.486740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.487552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.487828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.488100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] PATH_INFO: `/v3/projects/ca67c3671f6846cea3ace73809b81ef7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.489209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca67c3671f6846cea3ace73809b81ef7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.491336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.558949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca67c3671f6846cea3ace73809b81ef7', 'request_id': 'req-c739a91d-f3fc-4793-bf47-ea22fa3966f8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.570436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca67c3671f6846cea3ace73809b81ef7', 'request_id': 'req-c739a91d-f3fc-4793-bf47-ea22fa3966f8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.578425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca67c3671f6846cea3ace73809b81ef7', 'request_id': 'req-c739a91d-f3fc-4793-bf47-ea22fa3966f8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.593659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] The token cache is being invalidate because project ca67c3671f6846cea3ace73809b81ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:03.594206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.595546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.600118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1132/2240] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:03 2022] DELETE /identity/v3/projects/ca67c3671f6846cea3ace73809b81ef7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:03.604689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.616025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7a267-a8eb-4356-b854-6a770b6432bb service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.656501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:03.724818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.725449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.725723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.726202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] PATH_INFO: `/v3/users/71691b500d2d4820af0908ace58da670` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.727461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71691b500d2d4820af0908ace58da670)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.729451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.785314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71691b500d2d4820af0908ace58da670'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.786044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71691b500d2d4820af0908ace58da670'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.786741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71691b500d2d4820af0908ace58da670'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.817162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71691b500d2d4820af0908ace58da670'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.827501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-57b165f7-540b-41ef-a58e-3cce80be1f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71691b500d2d4820af0908ace58da670'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.847708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1109/2241] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:03 2022] DELETE /identity/v3/users/71691b500d2d4820af0908ace58da670 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:04.287020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.288674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.306148 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739a91d-f3fc-4793-bf47-ea22fa3966f8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.375181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.375807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.376612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.376882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] PATH_INFO: `/v3/projects/8bf9070b9b184fc0953081fdfe5ccea1` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.378031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf9070b9b184fc0953081fdfe5ccea1)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.379934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.409566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.427643 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf9070b9b184fc0953081fdfe5ccea1', 'request_id': 'req-509f635c-5650-4b7b-91e7-ef943484ae27'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.433597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf9070b9b184fc0953081fdfe5ccea1', 'request_id': 'req-509f635c-5650-4b7b-91e7-ef943484ae27'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.439471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf9070b9b184fc0953081fdfe5ccea1', 'request_id': 'req-509f635c-5650-4b7b-91e7-ef943484ae27'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.451239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] The token cache is being invalidate because project 8bf9070b9b184fc0953081fdfe5ccea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:04.451533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.452161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-509f635c-5650-4b7b-91e7-ef943484ae27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.453763 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1133/2242] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:04 2022] DELETE /identity/v3/projects/8bf9070b9b184fc0953081fdfe5ccea1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:04.461214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.462169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.462560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.482417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:04.483624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.550877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1110/2243] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:04.558960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.559451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.559546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.579396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:04.580602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.588932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1134/2244] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:04.593031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.602626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411d6b8-de73-49a7-89e8-93789fa6d468 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.607202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.607796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.608073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.608353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.609011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:04.609312 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.611484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.623179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1111/2245] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:04.627654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.636667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5b551-b3ac-448c-ab6c-1a5f39741b5a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.641284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.642440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.642713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.642979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.643599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.645502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.674412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1135/2246] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:04.678725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.689578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088287e-1331-41b0-9652-fdbc7fddbaf8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.719352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.780087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.781601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.782241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.782555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.783735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.786742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.820537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1112/2247] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:04.824776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.842123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984de0-5e55-49c3-b58c-12c2d1eae3ff admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.853699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.855024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.855308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.856131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.856592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.858363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.875375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1136/2248] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:04.880143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.893491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd05e-2a4c-4e85-b6ce-eaae261a77f3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.900066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6920926-2872-45bb-ab76-f464ccdb9a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.901009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920926-2872-45bb-ab76-f464ccdb9a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.901009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920926-2872-45bb-ab76-f464ccdb9a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.901249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920926-2872-45bb-ab76-f464ccdb9a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.902125 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920926-2872-45bb-ab76-f464ccdb9a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.903739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920926-2872-45bb-ab76-f464ccdb9a8d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.915671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1113/2249] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:04.919896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.931316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a1603-f8c9-4287-87c2-b8e495cb7ef5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.936182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.936894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.937173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.937447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] PATH_INFO: `/v3/projects/1efce467a3e14295a7dcd7490905b87e/users/843eded20669476ca549b3c6f65dafde/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.971207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efce467a3e14295a7dcd7490905b87e, user_id=843eded20669476ca549b3c6f65dafde, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.977018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.991896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1137/2250] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:04 2022] PUT /identity/v3/projects/1efce467a3e14295a7dcd7490905b87e/users/843eded20669476ca549b3c6f65dafde/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:05.002177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.002462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.002734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.031252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] MFA Rules not processed for user `843eded20669476ca549b3c6f65dafde`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:05.033008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.108479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1114/2251] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:05.120300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.122207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.204246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f46d2-19af-484d-9d2f-688231a08cab admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.210824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ddd0-6083-4ff3-b850-05a55cb0eccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.211641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ddd0-6083-4ff3-b850-05a55cb0eccc service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.212005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ddd0-6083-4ff3-b850-05a55cb0eccc service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.212405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ddd0-6083-4ff3-b850-05a55cb0eccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.238768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ddd0-6083-4ff3-b850-05a55cb0eccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.240953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ddd0-6083-4ff3-b850-05a55cb0eccc service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.257640 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1138/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:05.280244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.350694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d5721-0bf4-4a83-8742-26926e0d47d5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.356839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.357530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.357816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.358176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] PATH_INFO: `/v3/users/843eded20669476ca549b3c6f65dafde` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.359346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] RBAC: Authorizing `identity:delete_user(user_id=843eded20669476ca549b3c6f65dafde)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.361409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.452879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.461438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843eded20669476ca549b3c6f65dafde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.461438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843eded20669476ca549b3c6f65dafde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.462214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843eded20669476ca549b3c6f65dafde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.480167 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843eded20669476ca549b3c6f65dafde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.488442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843eded20669476ca549b3c6f65dafde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.501547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1115/2253] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:05 2022] DELETE /identity/v3/users/843eded20669476ca549b3c6f65dafde => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:05.506942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.507501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.508019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.530265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:05.532065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.584440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.601114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1139/2254] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:05.618899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.620606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.687373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbfd44-ab50-4581-8660-805e57f7bcba admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.691818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35e141-3d16-47e3-884c-b0c5af8d9a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.692634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e141-3d16-47e3-884c-b0c5af8d9a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.692850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e141-3d16-47e3-884c-b0c5af8d9a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.693235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e141-3d16-47e3-884c-b0c5af8d9a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.703491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35e141-3d16-47e3-884c-b0c5af8d9a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.705521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35e141-3d16-47e3-884c-b0c5af8d9a09 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.715515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1116/2255] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:06.118308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.119806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.132716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4901fd4-f2d2-490c-b11f-d60b97468400 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.143404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.144061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.144344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.144620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] PATH_INFO: `/v3/projects/1efce467a3e14295a7dcd7490905b87e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.145906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efce467a3e14295a7dcd7490905b87e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.148068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.217862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efce467a3e14295a7dcd7490905b87e', 'request_id': 'req-d20b2c0a-8347-41df-9390-6f1352f21e5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:06.225021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efce467a3e14295a7dcd7490905b87e', 'request_id': 'req-d20b2c0a-8347-41df-9390-6f1352f21e5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:06.234192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efce467a3e14295a7dcd7490905b87e', 'request_id': 'req-d20b2c0a-8347-41df-9390-6f1352f21e5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:06.249389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] The token cache is being invalidate because project 1efce467a3e14295a7dcd7490905b87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:06.249667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:06.250357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d20b2c0a-8347-41df-9390-6f1352f21e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:06.252522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1140/2256] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:06 2022] DELETE /identity/v3/projects/1efce467a3e14295a7dcd7490905b87e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:06.257489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.258019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.258333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.282019 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.283449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.353928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1117/2257] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:06.358919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.359489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.359864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.384506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.386462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.398166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1141/2258] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:06.399950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.414190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed62e7d-5623-4353-8e10-1aab23279be7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.419864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.420470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.420751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.421029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.421689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:06.422032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.424438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e084335-a5dd-4373-a5f9-f180c9e2c439 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.441110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1118/2259] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:06.446813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.457157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380926c-c288-4e47-b124-7e8ab608ea50 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.462504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35ea8-fcf6-47d7-937c-7cf98167fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.463248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35ea8-fcf6-47d7-937c-7cf98167fce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.463555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35ea8-fcf6-47d7-937c-7cf98167fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.463884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35ea8-fcf6-47d7-937c-7cf98167fce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.464438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35ea8-fcf6-47d7-937c-7cf98167fce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.466452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35ea8-fcf6-47d7-937c-7cf98167fce3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.472452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc06a01-9eaa-4075-ac7c-c0ce556b68a9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.473263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc06a01-9eaa-4075-ac7c-c0ce556b68a9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.473722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc06a01-9eaa-4075-ac7c-c0ce556b68a9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.475461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1119/2260] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:21:06.497427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1142/2261] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:06.501333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc06a01-9eaa-4075-ac7c-c0ce556b68a9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.519481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b6556-bd61-4183-a98e-3cab788105dd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.519790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b6556-bd61-4183-a98e-3cab788105dd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.520493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b6556-bd61-4183-a98e-3cab788105dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.566306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b03b6556-bd61-4183-a98e-3cab788105dd None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.566952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b03b6556-bd61-4183-a98e-3cab788105dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.578057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:06.604718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc06a01-9eaa-4075-ac7c-c0ce556b68a9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.611148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.611926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.612353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.613009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.613914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.616333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.650106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1120/2262] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:06.654386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.666061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1143/2263] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:06.666612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5cd80-d396-4d39-a8c7-63a84f642bd3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.677508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.678234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.678362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46869a6-f31c-4b3d-8363-72d2c20ca574 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.678564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.678666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46869a6-f31c-4b3d-8363-72d2c20ca574 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.678860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46869a6-f31c-4b3d-8363-72d2c20ca574 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.678958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.679932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.680188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1144/2264] 10.222.0.49 () {54 vars in 961 bytes} [Wed Aug 31 00:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:21:06.682406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.685633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.685633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.685976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.694356 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1121/2265] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:06.697941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.705925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] MFA Rules not processed for user `454c3f093d8d465294f2b0fe786a1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.707127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.712839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e356f-82f8-4a89-b4f8-1a8766281094 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.716003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1145/2266] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:06.720680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.721967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.722454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.722928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.723839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.724404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.726252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.738033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d9f5-fd5e-4f01-b498-154e0ae2f4cb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.744801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27558b3-9935-4ba2-a305-d8dcd86b2dff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.745151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1122/2267] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:06.746078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27558b3-9935-4ba2-a305-d8dcd86b2dff service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.746454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27558b3-9935-4ba2-a305-d8dcd86b2dff service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.746820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27558b3-9935-4ba2-a305-d8dcd86b2dff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.749630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.757137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27558b3-9935-4ba2-a305-d8dcd86b2dff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.759034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27558b3-9935-4ba2-a305-d8dcd86b2dff service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.759737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9c2b2-e75b-42ef-b239-c04c418a87a4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.766138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.766837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.767102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.767374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] PATH_INFO: `/v3/projects/bbbe3be86e5f4ffc8326ee36c3e5ce2e/users/e86a77ce787a47009fbdeb73ec904722/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.770699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1146/2268] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:06.784021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe3be86e5f4ffc8326ee36c3e5ce2e, user_id=e86a77ce787a47009fbdeb73ec904722, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.787681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.808890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1123/2269] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:06 2022] PUT /identity/v3/projects/bbbe3be86e5f4ffc8326ee36c3e5ce2e/users/e86a77ce787a47009fbdeb73ec904722/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:06.819069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.819351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.819625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.853823 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] MFA Rules not processed for user `e86a77ce787a47009fbdeb73ec904722`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.855246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.875403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:06.935388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1147/2270] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:06.946795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.965751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.052867 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a2e5b-890e-499f-b34b-d6a3de49a958 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.056537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.057132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.057407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.057676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.066293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.067833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.076988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1124/2271] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:07.263215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.264811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.356364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43edce-ad01-4b0d-9e49-e768de02b462 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.362322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.363104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.363531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.363782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] PATH_INFO: `/v3/users/e8e5a2450ba746008c4c4a7003007923` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.365079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e5a2450ba746008c4c4a7003007923)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.373712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.442204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e5a2450ba746008c4c4a7003007923'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.455506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e5a2450ba746008c4c4a7003007923'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.472809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e5a2450ba746008c4c4a7003007923'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.473738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e5a2450ba746008c4c4a7003007923'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.482989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e5a2450ba746008c4c4a7003007923'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.490218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1148/2272] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:07 2022] DELETE /identity/v3/users/e8e5a2450ba746008c4c4a7003007923 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:07.710753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.721885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffd9e6-00ac-400f-a2d1-ef04390cd93a service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.785975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.786680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.787022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.787299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] PATH_INFO: `/v3/projects/084c7856274f482785089444982c5969` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.788441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084c7856274f482785089444982c5969)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.790389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.832716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:07.843440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084c7856274f482785089444982c5969', 'request_id': 'req-fad25d4d-f171-4254-a56f-7bf4263658c2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.849735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084c7856274f482785089444982c5969', 'request_id': 'req-fad25d4d-f171-4254-a56f-7bf4263658c2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.858505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084c7856274f482785089444982c5969', 'request_id': 'req-fad25d4d-f171-4254-a56f-7bf4263658c2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.874283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] The token cache is being invalidate because project 084c7856274f482785089444982c5969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:07.874577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.875204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.877384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1125/2273] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:07 2022] DELETE /identity/v3/projects/084c7856274f482785089444982c5969 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:07.881367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.882788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.895698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7775c8-f19c-4fc1-b28d-24fce635bfe6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.927509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:07.958171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.958171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.958171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.958171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] PATH_INFO: `/v3/users/5856fcedb84745f29bcb701066dbfc28` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.959512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5856fcedb84745f29bcb701066dbfc28)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.961156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.011212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5856fcedb84745f29bcb701066dbfc28'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.019473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5856fcedb84745f29bcb701066dbfc28'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.033832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5856fcedb84745f29bcb701066dbfc28'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.034557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5856fcedb84745f29bcb701066dbfc28'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.041429 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-938416b1-c096-4c99-945e-71c790169c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5856fcedb84745f29bcb701066dbfc28'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.048439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1149/2274] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:07 2022] DELETE /identity/v3/users/5856fcedb84745f29bcb701066dbfc28 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:08.231590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.233009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.245917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25d4d-f171-4254-a56f-7bf4263658c2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.303536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.304166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.304450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.304722 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] PATH_INFO: `/v3/projects/153f3756e28b479bb31468711bef665e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.305861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=153f3756e28b479bb31468711bef665e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.307788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.359334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153f3756e28b479bb31468711bef665e', 'request_id': 'req-83f6701c-109b-4095-85ad-b045dd41b38c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.365515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153f3756e28b479bb31468711bef665e', 'request_id': 'req-83f6701c-109b-4095-85ad-b045dd41b38c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.371469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153f3756e28b479bb31468711bef665e', 'request_id': 'req-83f6701c-109b-4095-85ad-b045dd41b38c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.383965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] The token cache is being invalidate because project 153f3756e28b479bb31468711bef665e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:08.384254 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.384869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-83f6701c-109b-4095-85ad-b045dd41b38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.386378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1126/2275] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:08 2022] DELETE /identity/v3/projects/153f3756e28b479bb31468711bef665e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:08.392630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.392937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.393413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.413581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:08.414803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.487792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1150/2276] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:08.495382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.495739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.496074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.518220 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:08.519515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.529744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1127/2277] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:08.547023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.562802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16ecb3-40c8-4b28-b107-aa00aee1b859 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.567947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.568706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.569096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.569491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.570287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:08.570954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.572858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.586185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1151/2278] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:08.590866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.600665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8ed63-0418-421b-83dc-c9eb6bed1f56 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.605469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.606102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.606382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.606658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.607329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.609244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.639332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1128/2279] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:08.644627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.666189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54beb04-e325-43c8-87b8-73ffc6c08572 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.719196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.763518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.764145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.764425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.764701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.765333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.768014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.791431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1152/2280] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:08.795847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.809496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b167-2493-43b9-9c02-29dcd169f07d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.815842 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.816458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.816905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.817344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.818039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.819835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.835525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1129/2281] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:08.837722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.848373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4d755-0ea5-4a7c-a04e-e2912816173a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.853787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ada66a-a9ee-4e7e-81eb-049de359f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.854444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada66a-a9ee-4e7e-81eb-049de359f219 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.858059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada66a-a9ee-4e7e-81eb-049de359f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.858059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada66a-a9ee-4e7e-81eb-049de359f219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.858059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ada66a-a9ee-4e7e-81eb-049de359f219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.858059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ada66a-a9ee-4e7e-81eb-049de359f219 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.879470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1153/2282] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:08.883876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.895788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76deda6-4622-487e-9820-bf04edde3b17 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.900588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.901245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.901551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.901866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] PATH_INFO: `/v3/projects/a794587a32a74aecb473358c29e86f61/users/e281323087924523866cb64c5ef29fb2/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.913033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.917782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a794587a32a74aecb473358c29e86f61, user_id=e281323087924523866cb64c5ef29fb2, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.920696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.935409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1130/2283] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:08 2022] PUT /identity/v3/projects/a794587a32a74aecb473358c29e86f61/users/e281323087924523866cb64c5ef29fb2/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:08.946234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.946724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.947014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.976349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] MFA Rules not processed for user `e281323087924523866cb64c5ef29fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:08.977692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.042759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1154/2284] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.047544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.130058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ed1ec-921d-4ede-ae05-f9ffb69bd5e8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.130058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.130058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.130058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.130444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.130529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.132662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.164042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1131/2285] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:09.172555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.183792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16581c3c-1f76-41be-a76e-3f3bf877feea None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.242387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.243028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.243324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.243579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.244215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.246291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.268147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1155/2286] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:09.272186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.286840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b9617-7fb4-4706-8f74-94a13328ef3b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.292537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.293147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.293427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.293700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.294380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.296001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.309481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1132/2287] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:09.314444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.325327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2db5-d0c9-4042-ac45-6c9cd0507be9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.330692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da9b8-fc36-47ff-ae7f-c1e30bad84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.331307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da9b8-fc36-47ff-ae7f-c1e30bad84c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.331585 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da9b8-fc36-47ff-ae7f-c1e30bad84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.331857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da9b8-fc36-47ff-ae7f-c1e30bad84c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.332500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957da9b8-fc36-47ff-ae7f-c1e30bad84c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.334139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957da9b8-fc36-47ff-ae7f-c1e30bad84c5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.344555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1156/2288] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:09.354386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.365080 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678688d-d419-431d-926f-d71ba9a72424 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.369745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.370435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.370717 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.370989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] PATH_INFO: `/v3/projects/6260211e294646a6a7e1872e5e9cae11/users/86368a3ba2614c4aba0709741fcae063/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.386900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6260211e294646a6a7e1872e5e9cae11, user_id=86368a3ba2614c4aba0709741fcae063, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.389559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.402646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1133/2289] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:09 2022] PUT /identity/v3/projects/6260211e294646a6a7e1872e5e9cae11/users/86368a3ba2614c4aba0709741fcae063/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:09.414145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.414490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.414764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.445146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] MFA Rules not processed for user `86368a3ba2614c4aba0709741fcae063`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.446350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.461101 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:09.513616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1157/2290] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:09.518352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.589176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eca0e2-c3e0-4ccc-b9ce-b509f9efaad9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.594049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.595160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.595439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.595709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.596329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.598264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.625909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1134/2291] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:09.629903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.641264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8ccb9-65b1-4ea1-9c55-5a2fbf161e4c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.712677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.713278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.713556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.713828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.714510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.716562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.743793 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1158/2292] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:09.745229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.758678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ecee1-1483-418a-bfb9-101a72fd5330 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.764879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.765579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.766009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.766407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.767171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.769823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.790608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1135/2293] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:09.794641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.810912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a642e9-7118-4211-9416-a6c652809d49 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.815772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.816419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.816761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.817186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] PATH_INFO: `/v3/projects/5b05fd78ce4e4d1ba1c32fc24a985ef1/users/beb46e16eaaf4b15b7709dde6ce8b3e3/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.837098 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b05fd78ce4e4d1ba1c32fc24a985ef1, user_id=beb46e16eaaf4b15b7709dde6ce8b3e3, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.840061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.865051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1159/2294] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:09 2022] PUT /identity/v3/projects/5b05fd78ce4e4d1ba1c32fc24a985ef1/users/beb46e16eaaf4b15b7709dde6ce8b3e3/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:09.871079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.881951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1efc-a0b8-4912-bb62-af3e2d261768 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.890927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:09.960357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b6386-ee54-4d9d-8050-d1298a0fd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.961049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6386-ee54-4d9d-8050-d1298a0fd32d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.961878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6386-ee54-4d9d-8050-d1298a0fd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.961878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6386-ee54-4d9d-8050-d1298a0fd32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.963137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b6386-ee54-4d9d-8050-d1298a0fd32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.966770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b6386-ee54-4d9d-8050-d1298a0fd32d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.985248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1136/2295] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:09.993078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.004176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d0c01-7b17-454e-8ad2-2d1e09af21fa admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.015144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.016054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.016366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.017794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] PATH_INFO: `/v3/projects/5b05fd78ce4e4d1ba1c32fc24a985ef1/users/beb46e16eaaf4b15b7709dde6ce8b3e3/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.021666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b05fd78ce4e4d1ba1c32fc24a985ef1, user_id=beb46e16eaaf4b15b7709dde6ce8b3e3, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.025433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.046459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1160/2296] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:09 2022] PUT /identity/v3/projects/5b05fd78ce4e4d1ba1c32fc24a985ef1/users/beb46e16eaaf4b15b7709dde6ce8b3e3/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:10.055325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.055611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.056377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.119840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] MFA Rules not processed for user `beb46e16eaaf4b15b7709dde6ce8b3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:10.121154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:10.211348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1137/2297] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:10.223204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.224950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:10.283759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c27ca-5718-4bcf-a5ce-840504c3c865 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.287569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.288172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.288449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.288720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.308377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:10.345292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.346784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.355783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1161/2298] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:14.997985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.007492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a38ac-3156-4d59-bff1-5cc093f8f35e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.011013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.011601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.011876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.012146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.068460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.069991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.079147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1138/2299] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:18.159840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:18.168663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8d13f-a990-4eb2-b3ca-6f65eb02222e service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:18.172762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a05f7-33c3-4039-962a-94af04eec82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:18.173362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a05f7-33c3-4039-962a-94af04eec82c service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:18.173736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a05f7-33c3-4039-962a-94af04eec82c service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:18.173938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a05f7-33c3-4039-962a-94af04eec82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:18.183859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a05f7-33c3-4039-962a-94af04eec82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:18.185370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a05f7-33c3-4039-962a-94af04eec82c service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:18.195702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1162/2300] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:23.246679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.286604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:23.323051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134aa4-87bc-4fc4-a6e9-984a0dc8b5da service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.328676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.329393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.329663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.330017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] PATH_INFO: `/v3/users/e281323087924523866cb64c5ef29fb2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.332909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e281323087924523866cb64c5ef29fb2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.334990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.388590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e281323087924523866cb64c5ef29fb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.390253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e281323087924523866cb64c5ef29fb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.391127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e281323087924523866cb64c5ef29fb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.406801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e281323087924523866cb64c5ef29fb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.417564 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e281323087924523866cb64c5ef29fb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.432556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1139/2301] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:23 2022] DELETE /identity/v3/users/e281323087924523866cb64c5ef29fb2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:23.441076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.443526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.443800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.475066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:23.476351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.537587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1163/2302] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:23.549516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.551605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.612412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76b81b-0d2d-4166-940e-6a5568876bf0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.617454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.618111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.618400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.619066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.631431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.632943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.643585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1140/2303] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:23.952328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.954177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.986724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e6e5e-67ec-4bd0-9c51-1e303f432fa3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.992983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.993690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.994118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.994452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] PATH_INFO: `/v3/projects/a794587a32a74aecb473358c29e86f61` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.996409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a794587a32a74aecb473358c29e86f61)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.998538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.055996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a794587a32a74aecb473358c29e86f61', 'request_id': 'req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.063460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a794587a32a74aecb473358c29e86f61', 'request_id': 'req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.070755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a794587a32a74aecb473358c29e86f61', 'request_id': 'req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.086274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] The token cache is being invalidate because project a794587a32a74aecb473358c29e86f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:24.086567 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.087220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.088943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1164/2304] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:23 2022] DELETE /identity/v3/projects/a794587a32a74aecb473358c29e86f61 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:24.093247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.103468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b17bc8-65c3-4d2e-998b-8801f67a7011 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.158912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:24.169685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.170758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.170758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.171173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] PATH_INFO: `/v3/users/86368a3ba2614c4aba0709741fcae063` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.172687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86368a3ba2614c4aba0709741fcae063)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.175303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.243721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86368a3ba2614c4aba0709741fcae063'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.244301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86368a3ba2614c4aba0709741fcae063'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.244905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86368a3ba2614c4aba0709741fcae063'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.257569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86368a3ba2614c4aba0709741fcae063'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.266365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86368a3ba2614c4aba0709741fcae063'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.278487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1141/2305] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:24 2022] DELETE /identity/v3/users/86368a3ba2614c4aba0709741fcae063 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:24.577147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.578768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:24.596013 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a6622-eff5-4f08-834e-fdfc75a4a11e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.632665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:24.667155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.667814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.668096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.668368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] PATH_INFO: `/v3/projects/6260211e294646a6a7e1872e5e9cae11` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.669504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6260211e294646a6a7e1872e5e9cae11)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.671481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.719318 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6260211e294646a6a7e1872e5e9cae11', 'request_id': 'req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.725697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6260211e294646a6a7e1872e5e9cae11', 'request_id': 'req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.731190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6260211e294646a6a7e1872e5e9cae11', 'request_id': 'req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.743767 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] The token cache is being invalidate because project 6260211e294646a6a7e1872e5e9cae11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:24.744058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.744696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.746221 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1165/2306] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:24 2022] DELETE /identity/v3/projects/6260211e294646a6a7e1872e5e9cae11 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:24.750215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.751548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:24.764939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c34ada-941b-4bec-82da-a69395abf08c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.825014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.825641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.825951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.826232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] PATH_INFO: `/v3/users/beb46e16eaaf4b15b7709dde6ce8b3e3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.827357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb46e16eaaf4b15b7709dde6ce8b3e3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.829292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.883900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb46e16eaaf4b15b7709dde6ce8b3e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.884551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb46e16eaaf4b15b7709dde6ce8b3e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.885154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb46e16eaaf4b15b7709dde6ce8b3e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.897032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb46e16eaaf4b15b7709dde6ce8b3e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.904696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7dc38dff-dfb0-47e0-af43-cc0ae010ad6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb46e16eaaf4b15b7709dde6ce8b3e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.909354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:24.924913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1142/2307] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:24 2022] DELETE /identity/v3/users/beb46e16eaaf4b15b7709dde6ce8b3e3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:25.264747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:25.266300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:25.280860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e2ec5-0bfb-4ea2-a710-10a41b6478ca admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:25.363620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:25.364759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.365041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.366262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] PATH_INFO: `/v3/projects/5b05fd78ce4e4d1ba1c32fc24a985ef1` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.367478 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b05fd78ce4e4d1ba1c32fc24a985ef1)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:25.369654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:25.437692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b05fd78ce4e4d1ba1c32fc24a985ef1', 'request_id': 'req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.451315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b05fd78ce4e4d1ba1c32fc24a985ef1', 'request_id': 'req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.458255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b05fd78ce4e4d1ba1c32fc24a985ef1', 'request_id': 'req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.462926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:25.475593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] The token cache is being invalidate because project 5b05fd78ce4e4d1ba1c32fc24a985ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:25.476075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.476962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.478485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1166/2308] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:25 2022] DELETE /identity/v3/projects/5b05fd78ce4e4d1ba1c32fc24a985ef1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:34.402447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.403001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.403099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.423980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:34.425299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.495914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1143/2309] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:21:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:34.535349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.537045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.635467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec0c3-eaa8-48c2-8153-1583690d6d13 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.641428 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa9812-5095-4f95-ba53-c704ebb8145c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.642110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa9812-5095-4f95-ba53-c704ebb8145c service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.642394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa9812-5095-4f95-ba53-c704ebb8145c service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.642670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa9812-5095-4f95-ba53-c704ebb8145c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.653144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa9812-5095-4f95-ba53-c704ebb8145c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.655056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa9812-5095-4f95-ba53-c704ebb8145c service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:34.683435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1167/2310] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:21:34.686820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.688460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.806826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f966fa-b4c9-4523-9da7-205a9e6ecebb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.811922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.812878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.813368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.813821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] PATH_INFO: `/v3/users/89f6cfaf9c644abab9cda47b84f7a1eb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.815184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f6cfaf9c644abab9cda47b84f7a1eb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.817895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:34.907232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f6cfaf9c644abab9cda47b84f7a1eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.907979 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f6cfaf9c644abab9cda47b84f7a1eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.908653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f6cfaf9c644abab9cda47b84f7a1eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.932970 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f6cfaf9c644abab9cda47b84f7a1eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.957425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f6cfaf9c644abab9cda47b84f7a1eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.975552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1144/2311] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:34 2022] DELETE /identity/v3/users/89f6cfaf9c644abab9cda47b84f7a1eb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:34.979857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41653882-481f-47d5-9901-d8b0975722ba None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.980147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41653882-481f-47d5-9901-d8b0975722ba None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.980421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41653882-481f-47d5-9901-d8b0975722ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.001269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-41653882-481f-47d5-9901-d8b0975722ba None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.002522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-41653882-481f-47d5-9901-d8b0975722ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.074419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1168/2312] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.086640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.088180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.115883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:35.200166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc5f9-0493-436a-9d25-059d4f3dbaca admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.205106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214537e-5dc9-44a1-a02e-7de039144a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.206492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214537e-5dc9-44a1-a02e-7de039144a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.207199 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214537e-5dc9-44a1-a02e-7de039144a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.207902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214537e-5dc9-44a1-a02e-7de039144a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.220478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214537e-5dc9-44a1-a02e-7de039144a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.222120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214537e-5dc9-44a1-a02e-7de039144a53 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.234683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1145/2313] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:35.724868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41653882-481f-47d5-9901-d8b0975722ba None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.727069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-41653882-481f-47d5-9901-d8b0975722ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.809537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41653882-481f-47d5-9901-d8b0975722ba None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.855335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.855915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.856193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.856931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] PATH_INFO: `/v3/projects/24a949f527b842ed9991d9cd940164fa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.860424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a949f527b842ed9991d9cd940164fa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.863710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.966080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a949f527b842ed9991d9cd940164fa', 'request_id': 'req-73b1f426-515d-4771-bf17-82c5bf68bcc2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.977562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a949f527b842ed9991d9cd940164fa', 'request_id': 'req-73b1f426-515d-4771-bf17-82c5bf68bcc2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.985191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a949f527b842ed9991d9cd940164fa', 'request_id': 'req-73b1f426-515d-4771-bf17-82c5bf68bcc2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.021586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] The token cache is being invalidate because project 24a949f527b842ed9991d9cd940164fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:36.024634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.025935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.028186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1169/2314] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:35 2022] DELETE /identity/v3/projects/24a949f527b842ed9991d9cd940164fa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:36.034988 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5a5e-0077-468e-9b70-e60876389111 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.035556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5a5e-0077-468e-9b70-e60876389111 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.035556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5a5e-0077-468e-9b70-e60876389111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.060277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8f7e5a5e-0077-468e-9b70-e60876389111 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.061518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8f7e5a5e-0077-468e-9b70-e60876389111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.086772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.091676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.101617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.176459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1146/2315] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:36.179024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.179441 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.179720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.207257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.208498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.210028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1f426-515d-4771-bf17-82c5bf68bcc2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.215760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.216627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.217001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.217370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] PATH_INFO: `/v3/users/e86a77ce787a47009fbdeb73ec904722` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.218322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1147/2316] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:36.218868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86a77ce787a47009fbdeb73ec904722)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.220914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.223237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.233453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d3cf1-0c20-489c-8179-42dbfbdc38aa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.246614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.247247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.247514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.247802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.248464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:36.248765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.250566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.270055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1148/2317] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:36.274965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.289776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1d41-acdb-41ee-8812-b7556bc9bf0b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.293743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86a77ce787a47009fbdeb73ec904722'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.294898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.297275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.297275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.297275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.297587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.301599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.306908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86a77ce787a47009fbdeb73ec904722'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.321262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86a77ce787a47009fbdeb73ec904722'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.322086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86a77ce787a47009fbdeb73ec904722'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.339279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dde7b8d5-c0da-44b2-b96d-7dbdc42e52e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86a77ce787a47009fbdeb73ec904722'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.346791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1170/2318] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:36 2022] DELETE /identity/v3/users/e86a77ce787a47009fbdeb73ec904722 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:36.348322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1149/2319] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:36.355068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.356474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.356838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.357118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.357240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.381727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.382971 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.468460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdef1ea-dab0-42c1-8de9-e49f8f3f4034 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.495942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1171/2320] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:36.500155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.507783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.513632 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.560056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.560786 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.561194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.561659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.562530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.564544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.572186 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.609956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1150/2321] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:36.615027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.626999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cf555-ce83-4b24-9a3b-e71791b80fc0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.629452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513729d-2232-4489-94a0-e6b5c0fc106c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.636087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.636815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.637093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.637376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.638038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.639644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.642555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.643498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.643816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.644088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.663799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.665280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.669393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1151/2322] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:36.674168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.690046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1172/2323] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:36.697517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea225ff-e782-4778-a2bd-ecfd39d901f5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.709862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f512-527d-4a9f-b4aa-7b4abb992daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.713999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f512-527d-4a9f-b4aa-7b4abb992daf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.714829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f512-527d-4a9f-b4aa-7b4abb992daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.715382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f512-527d-4a9f-b4aa-7b4abb992daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.716860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28f512-527d-4a9f-b4aa-7b4abb992daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.719605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28f512-527d-4a9f-b4aa-7b4abb992daf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.751451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1152/2324] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:36.751995 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.763623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a127a-8041-4f69-9c4f-abc3e93c6eda service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.773985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.775111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.775506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.775788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] PATH_INFO: `/v3/projects/167da5798ea2451a9888a661b3c7f3e6/users/5d8054341c0e46778e3b3db0b3dd1164/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.796143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167da5798ea2451a9888a661b3c7f3e6, user_id=5d8054341c0e46778e3b3db0b3dd1164, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.799834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.835893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1173/2325] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:36 2022] PUT /identity/v3/projects/167da5798ea2451a9888a661b3c7f3e6/users/5d8054341c0e46778e3b3db0b3dd1164/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:36.840900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.841288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.841639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.877372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.879219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.014365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1153/2326] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.051619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.053641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.143552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.146443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.154374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fee1e-5776-471f-9621-0a09628ebc76 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.160000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad88cd-6b5c-4307-9163-61eeb5a35bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.174449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52a61-fbbe-4381-9a2b-81e74d23179a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.185694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad88cd-6b5c-4307-9163-61eeb5a35bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.186041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad88cd-6b5c-4307-9163-61eeb5a35bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.186325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad88cd-6b5c-4307-9163-61eeb5a35bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.186939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.187595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.187876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.188274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] PATH_INFO: `/v3/projects/bbbe3be86e5f4ffc8326ee36c3e5ce2e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.189824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbe3be86e5f4ffc8326ee36c3e5ce2e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.193923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.201366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad88cd-6b5c-4307-9163-61eeb5a35bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.203028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad88cd-6b5c-4307-9163-61eeb5a35bbb service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.225673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1174/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:37.294542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbe3be86e5f4ffc8326ee36c3e5ce2e', 'request_id': 'req-7bb1a082-3809-4273-823d-f525bcc34d39'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.305535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbe3be86e5f4ffc8326ee36c3e5ce2e', 'request_id': 'req-7bb1a082-3809-4273-823d-f525bcc34d39'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.315729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbe3be86e5f4ffc8326ee36c3e5ce2e', 'request_id': 'req-7bb1a082-3809-4273-823d-f525bcc34d39'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.332661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] The token cache is being invalidate because project bbbe3be86e5f4ffc8326ee36c3e5ce2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:37.333359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.334528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7bb1a082-3809-4273-823d-f525bcc34d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.336705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1154/2328] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:37 2022] DELETE /identity/v3/projects/bbbe3be86e5f4ffc8326ee36c3e5ce2e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:37.342359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.342654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.342984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.386787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:37.388616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.501372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1175/2329] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.512440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.512734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.513052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.540639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:37.542004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.551823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1155/2330] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.557086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.575781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5ce72-8d95-4ff9-a117-6236cbb21d47 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.582297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.582983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.583281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.583555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.584211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:37.584514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.586777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.606508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1176/2331] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:37.610573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.638275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0fc4-f130-49bd-86da-c769e5639d3c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.643513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.644160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.644438 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.644709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.645354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.647398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.663216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.690918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1156/2332] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:37.695331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.707656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae78852-c655-45bc-9eb5-961720d7aa02 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.764670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.806462 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.807083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.807696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.808214 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.808864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.811303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.864355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1177/2333] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:37.866137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.880610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f88c4f-57bd-49b7-895b-209411d41718 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.887618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.888471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.888849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.889222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.890005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.891805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.913907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1157/2334] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:37.917679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.931786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560560-0097-4d1f-b388-7db68ac64004 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.947648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa5c77-0832-4272-a85f-411fd1768cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.948247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa5c77-0832-4272-a85f-411fd1768cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.948527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa5c77-0832-4272-a85f-411fd1768cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.948799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa5c77-0832-4272-a85f-411fd1768cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.949968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa5c77-0832-4272-a85f-411fd1768cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.951270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa5c77-0832-4272-a85f-411fd1768cf7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.968269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1178/2335] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:37.973090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.989003 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1c920-20ff-4b19-a348-59755cf59d37 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.998838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.999585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.003856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.010855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] PATH_INFO: `/v3/projects/02d037c3825a4386a900e3f2dd64f7a0/users/dbf4078e541d4e2bb310e63ea92ed62a/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.043560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d037c3825a4386a900e3f2dd64f7a0, user_id=dbf4078e541d4e2bb310e63ea92ed62a, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.047894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.090063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.090810 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.091093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.094243 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1158/2336] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:37 2022] PUT /identity/v3/projects/02d037c3825a4386a900e3f2dd64f7a0/users/dbf4078e541d4e2bb310e63ea92ed62a/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:38.133084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] MFA Rules not processed for user `dbf4078e541d4e2bb310e63ea92ed62a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:38.134540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.249656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1179/2337] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:38.260017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.263861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.372935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b44b-dc98-4d4e-8a01-eff394fb2f34 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.377981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.380028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.380028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.380028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.404907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.407953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.421954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1159/2338] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:40.926750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.928452 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.088824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e3980-5096-4dc0-a468-e2fb3224932b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.093456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.094379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.094663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.094940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.103437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.218591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.226258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.236083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a10627-2151-47f3-a3c5-ae51371681bc service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.274601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1180/2339] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:42.905704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.073757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9545eb0-1119-43f2-b802-d66e35fe1a4c service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.083370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.084330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.085892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.086353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] PATH_INFO: `/v3/users/dbf4078e541d4e2bb310e63ea92ed62a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.088994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf4078e541d4e2bb310e63ea92ed62a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.092496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.197335 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf4078e541d4e2bb310e63ea92ed62a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.198439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf4078e541d4e2bb310e63ea92ed62a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.200031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf4078e541d4e2bb310e63ea92ed62a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.222855 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:43.232673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf4078e541d4e2bb310e63ea92ed62a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.249953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf4078e541d4e2bb310e63ea92ed62a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.274746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1160/2340] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:42 2022] DELETE /identity/v3/users/dbf4078e541d4e2bb310e63ea92ed62a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:43.280147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.281505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.282313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.340448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:43.345738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.523829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1181/2341] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:43.562271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.563851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.699823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655e3e-e038-4e9e-905b-a827523d8bbb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.710404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700feb01-699a-48d2-9713-75ca013c8232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.712184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700feb01-699a-48d2-9713-75ca013c8232 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.713126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700feb01-699a-48d2-9713-75ca013c8232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.713437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700feb01-699a-48d2-9713-75ca013c8232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.744741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700feb01-699a-48d2-9713-75ca013c8232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.747208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700feb01-699a-48d2-9713-75ca013c8232 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.763281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1161/2342] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:44.881297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.883762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.907610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5916c-cc71-4c15-8fbe-f2f7cc2afcc8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.922026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.929115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.929650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.930131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] PATH_INFO: `/v3/projects/02d037c3825a4386a900e3f2dd64f7a0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.937228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d037c3825a4386a900e3f2dd64f7a0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.941043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.088213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d037c3825a4386a900e3f2dd64f7a0', 'request_id': 'req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.117539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d037c3825a4386a900e3f2dd64f7a0', 'request_id': 'req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.140616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d037c3825a4386a900e3f2dd64f7a0', 'request_id': 'req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.164128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] The token cache is being invalidate because project 02d037c3825a4386a900e3f2dd64f7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:45.164519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.166122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1ba2497f-4bfa-408e-aea9-0fc89f2ddc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.167873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1182/2343] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/projects/02d037c3825a4386a900e3f2dd64f7a0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:45.173281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.174187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.174748 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.209756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:45.211397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.423758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1162/2344] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:45.425572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816e46-7d9c-48e7-aeb2-9b386929e3db None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.426254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816e46-7d9c-48e7-aeb2-9b386929e3db None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.426254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816e46-7d9c-48e7-aeb2-9b386929e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.473016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e2816e46-7d9c-48e7-aeb2-9b386929e3db None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:45.474680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e2816e46-7d9c-48e7-aeb2-9b386929e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.485786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1183/2345] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:45.490754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.510650 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ccbec-e533-4255-9102-2510ed2ae379 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.524666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.526250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.526698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.527121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.528100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:45.528544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.530543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.539938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.540602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.541027 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.583955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1163/2346] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:45.588018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.604261 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] MFA Rules not processed for user `5d8054341c0e46778e3b3db0b3dd1164`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:45.606067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.610749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389f34f-bfda-4f39-a29e-49d1d2d6562e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.622138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.622768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.623053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.623327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.623982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.625996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.693971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1164/2347] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:45.697474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.730374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:45.747862 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1184/2348] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:45.748812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.750335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.758261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:45.772846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ff63-1477-431b-bf0c-a943b01895e3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.780562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.781410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.781874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.782462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.784025 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.784557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7020fc-379c-4331-b1f0-66da2f9cf814 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.787411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.795729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.797343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.798243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.798988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.800725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.816926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.819361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1165/2349] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:45.823413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.880188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84fb38-593b-495b-94bd-46b333aa9336 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.892418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1185/2350] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:45.892418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.911329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.912014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.912316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.912588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.913251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.914930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.945530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1166/2351] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:45.946102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.972912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ad07-10a5-4ee7-813d-65e464b69bdc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.062972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fda57-99fc-41e1-b6dd-0f5737b2ffdd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.069601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.070459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.070866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.072097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.075045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.091981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.162615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.162615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.162615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.162615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.165829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.165829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.165829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1167/2352] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:46.165829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.195263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1990068-2c86-419d-b13b-ffd41323ec9f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.200225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1186/2353] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/users => generated 296 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:46.201521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f2a4-9162-49d0-977a-8c08dc4fda15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.202336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.202554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f2a4-9162-49d0-977a-8c08dc4fda15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.202920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f2a4-9162-49d0-977a-8c08dc4fda15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.203495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f2a4-9162-49d0-977a-8c08dc4fda15 admin admin] PATH_INFO: `/v3/projects/ca1873f74b254404ae941502ce727171/users/b7d01666f3d64d62954c0befea66b544/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.220653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4fd8a-f36e-428e-bdf7-6ccfde56178f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.226738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6f2a4-9162-49d0-977a-8c08dc4fda15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1873f74b254404ae941502ce727171, user_id=b7d01666f3d64d62954c0befea66b544, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.229012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.229732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.230132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6f2a4-9162-49d0-977a-8c08dc4fda15 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.230394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.230724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.231688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.233423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.249882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1187/2354] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:46.254821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.263379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1168/2355] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:46 2022] PUT /identity/v3/projects/ca1873f74b254404ae941502ce727171/users/b7d01666f3d64d62954c0befea66b544/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:46.271746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e389c8-660c-4e9a-aa6a-5f29b6a41547 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.277439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.277819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.278145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.332286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] MFA Rules not processed for user `b7d01666f3d64d62954c0befea66b544`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.335065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.398820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.400390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.400877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.401378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] PATH_INFO: `/v3/projects/40b1228034f841ce92abeef3afe3e871/users/3d02e834967b4b2a96e92fc4183bce56/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.436785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b1228034f841ce92abeef3afe3e871, user_id=3d02e834967b4b2a96e92fc4183bce56, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.440128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.448387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1169/2356] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:46.483495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1188/2357] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:46 2022] PUT /identity/v3/projects/40b1228034f841ce92abeef3afe3e871/users/3d02e834967b4b2a96e92fc4183bce56/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:46.488539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.515596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576758e6-84e3-4fa8-b4ac-c923f7564b69 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.555206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:46.627631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab6a5c-c8cd-4c72-a2c3-6189fa065a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.628280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab6a5c-c8cd-4c72-a2c3-6189fa065a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.628554 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab6a5c-c8cd-4c72-a2c3-6189fa065a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.628822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab6a5c-c8cd-4c72-a2c3-6189fa065a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.629528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab6a5c-c8cd-4c72-a2c3-6189fa065a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.631696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab6a5c-c8cd-4c72-a2c3-6189fa065a7b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.651944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1170/2358] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:46.657728 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.674008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e5958-b2f9-49cc-956f-36e245325317 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.680028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.681641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.682195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.682692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] PATH_INFO: `/v3/projects/40b1228034f841ce92abeef3afe3e871/users/3d02e834967b4b2a96e92fc4183bce56/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.685361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b1228034f841ce92abeef3afe3e871, user_id=3d02e834967b4b2a96e92fc4183bce56, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.688438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.724547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1189/2359] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:46 2022] PUT /identity/v3/projects/40b1228034f841ce92abeef3afe3e871/users/3d02e834967b4b2a96e92fc4183bce56/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:48.124591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebec804-d0f5-480a-b9a1-768c4b5c7a44 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.125176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebec804-d0f5-480a-b9a1-768c4b5c7a44 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.125176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebec804-d0f5-480a-b9a1-768c4b5c7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.167329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4ebec804-d0f5-480a-b9a1-768c4b5c7a44 None None] MFA Rules not processed for user `c924dfe7e9c941f9b7110c1a440633dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:48.168577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4ebec804-d0f5-480a-b9a1-768c4b5c7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:48.303170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1171/2360] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:48.625631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:48.629310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:48.744018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:48.830784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee2dc1-8cc2-41cf-843b-23b131e2356c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:48.843505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:48.844143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.844417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.844685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:49.020801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:49.023501 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:49.035957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1190/2361] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:58.295508 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=43 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:58.890532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826aa0a-8f29-4121-abf4-d88500245b71 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.890811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826aa0a-8f29-4121-abf4-d88500245b71 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.891266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826aa0a-8f29-4121-abf4-d88500245b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.925179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d826aa0a-8f29-4121-abf4-d88500245b71 None None] MFA Rules not processed for user `3d02e834967b4b2a96e92fc4183bce56`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:58.926347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d826aa0a-8f29-4121-abf4-d88500245b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:59.022280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1172/2362] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:21:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:59.030311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=36 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:59.036828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:59.038427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:59.144426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca34a-9722-485c-83a0-298225a175c6 service glance] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:59.150396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278797-bf1d-4864-81ca-910522e392b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:59.151094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278797-bf1d-4864-81ca-910522e392b7 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:59.151598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278797-bf1d-4864-81ca-910522e392b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:59.152152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278797-bf1d-4864-81ca-910522e392b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:59.224621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef278797-bf1d-4864-81ca-910522e392b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:59.226594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef278797-bf1d-4864-81ca-910522e392b7 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:59.252933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1191/2363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:05.832147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2fba8-e400-4dab-b639-304776f79108 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:05.832743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2fba8-e400-4dab-b639-304776f79108 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:05.833093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2fba8-e400-4dab-b639-304776f79108 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:05.834464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1173/2364] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:22:05.840791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:05.841250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:05.841359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:05.869765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:05.871134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:05.881946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1192/2365] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:09.014792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=34 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:11.123682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2fba8-e400-4dab-b639-304776f79108 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.125421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6ee2fba8-e400-4dab-b639-304776f79108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:11.204263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2fba8-e400-4dab-b639-304776f79108 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.209194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.209776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.210077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.210343 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.212029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:11.223534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.225103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50a9e2-93ae-4585-8197-cfb2db94989c service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.237646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1174/2366] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:12.838375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:12.847677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d41010-30d4-4b18-b495-22dc9807cb5c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:12.851258 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406470f-b7d6-4965-9e08-c3c5cb5e21a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:12.851848 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406470f-b7d6-4965-9e08-c3c5cb5e21a6 service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:12.852123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406470f-b7d6-4965-9e08-c3c5cb5e21a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:12.852391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406470f-b7d6-4965-9e08-c3c5cb5e21a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:12.871680 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406470f-b7d6-4965-9e08-c3c5cb5e21a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:12.872878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406470f-b7d6-4965-9e08-c3c5cb5e21a6 service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:12.884589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1193/2367] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:12.960874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593eba1-ffb6-4f1d-9c13-7a571814175e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:12.960874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593eba1-ffb6-4f1d-9c13-7a571814175e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:12.960874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593eba1-ffb6-4f1d-9c13-7a571814175e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:12.962381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1175/2368] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:22:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:22:12.967410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6930-f53c-45b5-a24a-3a37f7315c8d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:12.967698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6930-f53c-45b5-a24a-3a37f7315c8d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:12.968004 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6930-f53c-45b5-a24a-3a37f7315c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:12.991205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-60bf6930-f53c-45b5-a24a-3a37f7315c8d None None] MFA Rules not processed for user `f83352aa0c3843e09f2a666b753a7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:12.991205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-60bf6930-f53c-45b5-a24a-3a37f7315c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:13.046781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1194/2369] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:13.059023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593eba1-ffb6-4f1d-9c13-7a571814175e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:13.060831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1593eba1-ffb6-4f1d-9c13-7a571814175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:13.074239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593eba1-ffb6-4f1d-9c13-7a571814175e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:13.077744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f2496-0a7c-4baa-97a7-daf79a207f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:13.078375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2496-0a7c-4baa-97a7-daf79a207f82 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:13.078654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2496-0a7c-4baa-97a7-daf79a207f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:13.078927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2496-0a7c-4baa-97a7-daf79a207f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:13.086186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2496-0a7c-4baa-97a7-daf79a207f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:13.087613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f2496-0a7c-4baa-97a7-daf79a207f82 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:13.099387 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1176/2370] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:13.202512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066a017-25f3-465b-9ef3-0f96a947c271 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:13.202869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066a017-25f3-465b-9ef3-0f96a947c271 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:13.203242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066a017-25f3-465b-9ef3-0f96a947c271 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:13.207034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1195/2371] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 31 00:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:22:13.210277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04f2f-37fa-4d5c-b83b-438564adbbf6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:13.210540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04f2f-37fa-4d5c-b83b-438564adbbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:13.210816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04f2f-37fa-4d5c-b83b-438564adbbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:13.230430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d2f04f2f-37fa-4d5c-b83b-438564adbbf6 None None] MFA Rules not processed for user `5d50090e8a924a76b634807f00734c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:13.231665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d2f04f2f-37fa-4d5c-b83b-438564adbbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:13.241597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1177/2372] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 31 00:22:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:13.255016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066a017-25f3-465b-9ef3-0f96a947c271 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:13.265655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066a017-25f3-465b-9ef3-0f96a947c271 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:13.269316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:13.269949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:13.270227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:13.270498 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:13.281057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:13.282586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:13.294494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1196/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:23.225321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=41 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:23.289804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:26.121067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502a9f-872b-4a66-9a45-e5dfaa979e49 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:26.121599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502a9f-872b-4a66-9a45-e5dfaa979e49 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:26.121599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e502a9f-872b-4a66-9a45-e5dfaa979e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:26.154206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6e502a9f-872b-4a66-9a45-e5dfaa979e49 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:26.155993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6e502a9f-872b-4a66-9a45-e5dfaa979e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:26.234769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1178/2374] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:22:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:26.250280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:26.254017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:26.342477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4048883-79ea-4431-a973-8a675aaacc8a service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:26.347900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:26.348520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:26.349884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:26.349884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:26.363592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:26.363592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:26.372217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1197/2375] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:22:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:36.223484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=25 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:36.368581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=32 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:42.714955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640be336-9f64-4d38-93cc-6a57905787db None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.715594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640be336-9f64-4d38-93cc-6a57905787db None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.715806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640be336-9f64-4d38-93cc-6a57905787db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.737292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-640be336-9f64-4d38-93cc-6a57905787db None None] MFA Rules not processed for user `5d8054341c0e46778e3b3db0b3dd1164`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:42.739016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-640be336-9f64-4d38-93cc-6a57905787db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.745724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1179/2376] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:45.926889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:45.986707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d788-caf0-4344-a26e-720d82a24b18 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:45.991288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:45.991858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:45.992136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:45.992408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] PATH_INFO: `/v3/users/b7d01666f3d64d62954c0befea66b544` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:45.993500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d01666f3d64d62954c0befea66b544)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:45.995446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.041920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d01666f3d64d62954c0befea66b544'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.049247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d01666f3d64d62954c0befea66b544'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.061235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d01666f3d64d62954c0befea66b544'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.062178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d01666f3d64d62954c0befea66b544'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.069813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d01666f3d64d62954c0befea66b544'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.076219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1198/2377] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:45 2022] DELETE /identity/v3/users/b7d01666f3d64d62954c0befea66b544 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:46.080945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.081463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.081569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.103627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:46.104831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.161589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1180/2378] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:46.171629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.173082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.232983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892b06-0d0a-4d68-8c7d-67bd6c4c6e8f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.236768 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2734-f498-4153-a096-2168b324ef25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.237434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2734-f498-4153-a096-2168b324ef25 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.238073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2734-f498-4153-a096-2168b324ef25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.238222 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2734-f498-4153-a096-2168b324ef25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.247900 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2734-f498-4153-a096-2168b324ef25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.249286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe2734-f498-4153-a096-2168b324ef25 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.259308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1199/2379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:46.559366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.561940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.576502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c58b30-480b-42c2-8cba-28d050632931 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.605585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.606363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.606846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.607298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] PATH_INFO: `/v3/projects/ca1873f74b254404ae941502ce727171` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.608716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1873f74b254404ae941502ce727171)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.610907 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.665464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1873f74b254404ae941502ce727171', 'request_id': 'req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.672459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1873f74b254404ae941502ce727171', 'request_id': 'req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.678807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1873f74b254404ae941502ce727171', 'request_id': 'req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.692106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] The token cache is being invalidate because project ca1873f74b254404ae941502ce727171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:46.692400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.693144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b669b38c-2db6-42d8-b6a6-91ca4f5a84c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.694665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1181/2380] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:46 2022] DELETE /identity/v3/projects/ca1873f74b254404ae941502ce727171 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:46.703775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.704082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.704376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.723744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:46.724945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.742629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:46.785745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1200/2381] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:46.793310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.793611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.794022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.814040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:46.815160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.823459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1182/2382] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:46.827445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.837081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d388b-bd08-451e-9cfa-138b067571d2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.841660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.842291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.842570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.842841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.843486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:46.843784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.845374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.864781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1201/2383] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:46.868515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.878377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd6571-7a22-47fc-abbc-7407691cbb53 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.883611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.884244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.884521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.884792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.885429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.887402 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.919917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1183/2384] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:46 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:46.921427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.932121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a77c1-4bba-4a64-8a14-476adf26680c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.986973 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.987572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.987851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.988777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.989399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.991352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:47.013064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1202/2385] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:46 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:47.017139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:47.027317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5010ac-bc21-4434-b070-1202fd59f83e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:47.031950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:47.032542 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:47.032821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:47.033094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:47.033764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:47.035901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:47.045896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1184/2386] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:47.049636 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:47.059861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3c0e4-8b8d-42b7-8072-d8373ffc1317 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:47.064421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e06a-a7c5-455b-9ff8-4767138c50e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:47.064943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e06a-a7c5-455b-9ff8-4767138c50e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:47.065217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e06a-a7c5-455b-9ff8-4767138c50e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:47.065485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e06a-a7c5-455b-9ff8-4767138c50e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:47.066169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e06a-a7c5-455b-9ff8-4767138c50e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:47.067750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e06a-a7c5-455b-9ff8-4767138c50e1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:47.077896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1203/2387] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:47.081779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:47.091606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2941359-5ca9-4ed4-9469-5202d511473f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:47.096209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:47.096841 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:47.097122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:47.097936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] PATH_INFO: `/v3/projects/0b197ae495354fd8831c3d5b479442da/users/4cb8a23df369457e93a6f9fa5dce46ca/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:47.112280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b197ae495354fd8831c3d5b479442da, user_id=4cb8a23df369457e93a6f9fa5dce46ca, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:47.115521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:47.128113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1185/2388] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:47 2022] PUT /identity/v3/projects/0b197ae495354fd8831c3d5b479442da/users/4cb8a23df369457e93a6f9fa5dce46ca/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:47.139550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42da8-633d-4e0e-914d-51f34d8fe5f8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:47.139838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42da8-633d-4e0e-914d-51f34d8fe5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:47.140113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42da8-633d-4e0e-914d-51f34d8fe5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:47.167663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-24a42da8-633d-4e0e-914d-51f34d8fe5f8 None None] MFA Rules not processed for user `4cb8a23df369457e93a6f9fa5dce46ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:47.168871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-24a42da8-633d-4e0e-914d-51f34d8fe5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:47.232310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1204/2389] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:22:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:47.244286 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:47.245982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:47.261882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:47.312063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755888ef-6ff1-4dbc-8029-2a0a2eb42447 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:47.315827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cba449ceaf8746779958a1278e6d4cc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:47.316367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:47.316649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:47.317023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:47.325171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:47.326636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:47.336188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1186/2390] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:54.314836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2308-2db3-4c90-88d3-ad52b35841ea None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:54.315336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2308-2db3-4c90-88d3-ad52b35841ea None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:54.315451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2308-2db3-4c90-88d3-ad52b35841ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:54.337766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-aa5f2308-2db3-4c90-88d3-ad52b35841ea None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:54.339361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aa5f2308-2db3-4c90-88d3-ad52b35841ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:54.354897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:54.415752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1205/2391] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 00:22:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:54.438883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:54.440643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:54.549156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94e7f9-ff76-4010-ba64-975795b20edc service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:54.569771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:54.569771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:54.569771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:54.569771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:54.581215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:54.583495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:54.594824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1187/2392] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:22:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:04.406098 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=17 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:04.589340 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=52 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:08.407198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:08.407681 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:08.407776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:08.427302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] MFA Rules not processed for user `4e57290be8d341db824952c83703b118`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:08.428509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:08.482350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1206/2393] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:14.039640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:14.041027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:14.097120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d8db-f645-4747-a5c3-eae572a50130 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:14.100747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:14.101337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:14.101614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:14.101916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:14.103624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:14.167097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:14.168529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195392-c865-4540-a45a-7f95210c875c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:14.178180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1188/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:18.475651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=25 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:24.173935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=50 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:26.760247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:26.823294 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e3926-cf71-4c79-821b-f7e2ce463f27 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:26.827699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:26.828321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.828595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.828861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] PATH_INFO: `/v3/users/4cb8a23df369457e93a6f9fa5dce46ca` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.829981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb8a23df369457e93a6f9fa5dce46ca)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:26.831898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:26.878606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb8a23df369457e93a6f9fa5dce46ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:26.886497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb8a23df369457e93a6f9fa5dce46ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:26.898743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb8a23df369457e93a6f9fa5dce46ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:26.899395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb8a23df369457e93a6f9fa5dce46ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:26.906225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb8a23df369457e93a6f9fa5dce46ca'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:26.911990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1207/2395] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:26 2022] DELETE /identity/v3/users/4cb8a23df369457e93a6f9fa5dce46ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:26.916412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.916909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.917018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.936271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:26.937451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:26.993962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1189/2396] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:27.003701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:27.005712 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:27.061838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea0b90-5b58-4aeb-b836-9e847b717c39 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:27.065480 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:27.066112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:27.066393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:27.066663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:27.076202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:27.077638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:27.086982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1208/2397] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:27.358091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:27.359642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:27.374217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a1d4-be9f-4093-864f-3e03dd51bad3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:27.379644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:27.380275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:27.380553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:27.380827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] PATH_INFO: `/v3/projects/0b197ae495354fd8831c3d5b479442da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:27.381995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b197ae495354fd8831c3d5b479442da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:27.383975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:27.431186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b197ae495354fd8831c3d5b479442da', 'request_id': 'req-afbb5b9a-cf03-4e88-960a-62b2ea01e004'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:27.437367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b197ae495354fd8831c3d5b479442da', 'request_id': 'req-afbb5b9a-cf03-4e88-960a-62b2ea01e004'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:27.443917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b197ae495354fd8831c3d5b479442da', 'request_id': 'req-afbb5b9a-cf03-4e88-960a-62b2ea01e004'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:27.456998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] The token cache is being invalidate because project 0b197ae495354fd8831c3d5b479442da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:27.457280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:27.458089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:27.459636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1190/2398] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:27 2022] DELETE /identity/v3/projects/0b197ae495354fd8831c3d5b479442da => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:37.083390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:37.453894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:03.692157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:03.693670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.766461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429389-166e-4a51-8cbc-3c6579d75e79 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.827902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.828500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.828780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.829052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.830780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.887178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.888776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:03.898333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1209/2399] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:06.294608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:06.296152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:06.354180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5b9a-cf03-4e88-960a-62b2ea01e004 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:06.357775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:06.358409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:06.358687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:06.358960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:06.360836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:06.375193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:06.376828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:06.391778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1191/2400] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:07.214677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.216093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.230490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0cac2-57c7-4468-a8b2-215b64d36ea8 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.236107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.236726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.237023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.237291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.239014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.271495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:07.297120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.298694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43165a8f-c9d2-4827-969e-6b3db03d2ebc service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.307490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1210/2401] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:08.742696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:08.744101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:08.754504 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fae3d-5ee9-418e-b40e-0d89861fc314 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:08.758618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:08.759202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:08.759479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:08.759750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:08.761379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:08.774744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:08.776225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140c04-8297-4a17-b62c-504bcfe9d4ac service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:08.786821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1192/2402] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:14.793612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.794413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.794532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.814752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] MFA Rules not processed for user `c924dfe7e9c941f9b7110c1a440633dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:14.815958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:14.823626 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1211/2403] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:18.782314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=32 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:24.809734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=15 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:27.865629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:27.866148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:27.866495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:27.886277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] MFA Rules not processed for user `a76438b57a2140cca853e0e71fb28f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:27.887541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:27.894737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1193/2404] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:28.214065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.223696 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241006ef-ec98-4ade-afee-f90a30b9f97e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.227268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.227859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.228139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.228413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.230130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:28.239385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.240834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.248836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1212/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:28.567700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:28.569165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:28.638770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0313e-4ca1-4d2c-a3be-e21b44055b52 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:28.643740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:28.644344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:28.644625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:28.644898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:28.647150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:28.658143 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:28.659712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028fa87-3481-4b8d-9871-4a419ffa25d2 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:28.670124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1194/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:32.429256 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:32.439122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306beaa-f0b5-46ca-9d23-634844725b19 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:32.443868 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:32.444653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:32.444933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:32.445208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:32.447154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:32.457447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:32.459506 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:32.469290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1213/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:38.665787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=35 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.986567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.986853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.987132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:39.008904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:39.010166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:39.070495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1195/2408] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:39.120103 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:39.122166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:39.193386 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9e56b-8198-453d-8de2-6b080690bc42 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:39.198496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:39.199104 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:39.199485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:39.199657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:39.207874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:39.209489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:39.218818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1214/2409] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:41.018171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:41.039687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48add2-ac3d-4b3d-b554-dd38d013bfb0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:41.047296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:41.047926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:41.048276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:41.048555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:41.052124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:41.069576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:41.071436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:41.083291 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1196/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:41.484276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:41.485708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:41.500336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bdfb8-a3c0-482c-be70-569dd6b8034d service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:41.506229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:41.506824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:41.507099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:41.507366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:41.509065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:41.520661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:41.522260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:41.532784 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1215/2411] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:41.657645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:41.659151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:41.759403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39de6-c99d-4022-ade3-70030112d898 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:41.764563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:41.765194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:41.765473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:41.765746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] PATH_INFO: `/v3/users/4e57290be8d341db824952c83703b118` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:41.766996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e57290be8d341db824952c83703b118)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:41.768931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:41.829519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e57290be8d341db824952c83703b118'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:41.832385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e57290be8d341db824952c83703b118'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:41.834253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e57290be8d341db824952c83703b118'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:41.851480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e57290be8d341db824952c83703b118'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:41.867052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e57290be8d341db824952c83703b118'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:41.880705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1197/2412] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:41 2022] DELETE /identity/v3/users/4e57290be8d341db824952c83703b118 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:42.475866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:42.487289 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02444d2-6d7b-4dc4-b172-7ffa2773325b service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:42.548560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:42.549224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:42.549551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:42.549928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] PATH_INFO: `/v3/projects/80dbc22f8641481291939540b00e0225` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:42.551117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80dbc22f8641481291939540b00e0225)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:42.553657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:42.600291 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80dbc22f8641481291939540b00e0225', 'request_id': 'req-30ad3218-5cbf-4860-b105-cec05eda7b60'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:42.602404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:42.608578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80dbc22f8641481291939540b00e0225', 'request_id': 'req-30ad3218-5cbf-4860-b105-cec05eda7b60'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:42.614557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80dbc22f8641481291939540b00e0225', 'request_id': 'req-30ad3218-5cbf-4860-b105-cec05eda7b60'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:42.627062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] The token cache is being invalidate because project 80dbc22f8641481291939540b00e0225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:42.627336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:42.627966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:42.629979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1216/2413] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:42 2022] DELETE /identity/v3/projects/80dbc22f8641481291939540b00e0225 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:45.335669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:45.337198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:45.352692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:45.423558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8f3e-ce74-4d54-b64d-2d301262d370 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:45.519213 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:45.520100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:45.520566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:45.520996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:45.524047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:45.539534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:45.542349 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:45.555915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1198/2414] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:47.732808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:47.734328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:47.802044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad3218-5cbf-4860-b105-cec05eda7b60 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:47.807831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:47.808699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:47.809078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:47.809448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] PATH_INFO: `/v3/users/cdd2a01bf81d406e877a1c4ace635704` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:47.810715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd2a01bf81d406e877a1c4ace635704)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:47.813509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:47.866107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd2a01bf81d406e877a1c4ace635704'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:47.874047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd2a01bf81d406e877a1c4ace635704'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:47.887393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd2a01bf81d406e877a1c4ace635704'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:47.887986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd2a01bf81d406e877a1c4ace635704'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:47.895381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd2a01bf81d406e877a1c4ace635704'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:47.901195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1217/2415] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:47 2022] DELETE /identity/v3/users/cdd2a01bf81d406e877a1c4ace635704 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:48.070359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.084224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c0b6e-bc50-41af-91c0-36335856532f service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:48.152845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:48.153386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.153665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.154028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] PATH_INFO: `/v3/projects/96ac355089a14695a3e062290443283e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.155168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ac355089a14695a3e062290443283e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:48.157172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:48.198506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:48.208234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ac355089a14695a3e062290443283e', 'request_id': 'req-8f8c182e-4541-4e84-b853-d814be215650'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.214399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ac355089a14695a3e062290443283e', 'request_id': 'req-8f8c182e-4541-4e84-b853-d814be215650'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.219972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ac355089a14695a3e062290443283e', 'request_id': 'req-8f8c182e-4541-4e84-b853-d814be215650'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.234037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] The token cache is being invalidate because project 96ac355089a14695a3e062290443283e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:48.234333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.234991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.236473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1199/2416] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:48 2022] DELETE /identity/v3/projects/96ac355089a14695a3e062290443283e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:48.241208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.242749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:48.255592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c850f-5703-42e3-904f-93804a7386b0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:48.312738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:48.313362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.313657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.313945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] PATH_INFO: `/v3/users/435115d080c8427c9d21c93cc058774d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.315046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=435115d080c8427c9d21c93cc058774d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:48.317015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:48.318527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:48.365207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435115d080c8427c9d21c93cc058774d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.372484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435115d080c8427c9d21c93cc058774d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.384520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435115d080c8427c9d21c93cc058774d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.385507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435115d080c8427c9d21c93cc058774d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.392439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435115d080c8427c9d21c93cc058774d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.399218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1218/2417] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:48 2022] DELETE /identity/v3/users/435115d080c8427c9d21c93cc058774d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:48.569779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.571296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:48.586663 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c182e-4541-4e84-b853-d814be215650 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:48.631996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.633417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:48.646944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:48.647573 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.647854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.648135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] PATH_INFO: `/v3/projects/2ad4273b3e174ffc971766fc7a30a20c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.649257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad4273b3e174ffc971766fc7a30a20c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:48.651229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:48.693336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acabfc-d852-4ab0-bf3a-adb41daae80a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:48.697393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad4273b3e174ffc971766fc7a30a20c', 'request_id': 'req-602cd2a8-5c79-4651-b954-ce1f78758684'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.703512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad4273b3e174ffc971766fc7a30a20c', 'request_id': 'req-602cd2a8-5c79-4651-b954-ce1f78758684'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.709691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad4273b3e174ffc971766fc7a30a20c', 'request_id': 'req-602cd2a8-5c79-4651-b954-ce1f78758684'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.723931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] The token cache is being invalidate because project 2ad4273b3e174ffc971766fc7a30a20c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:48.724515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.725229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-602cd2a8-5c79-4651-b954-ce1f78758684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:48.726773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1200/2418] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:48 2022] DELETE /identity/v3/projects/2ad4273b3e174ffc971766fc7a30a20c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:48.731483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769cdd3-3d9e-4929-bd7d-ad6cfacdf51e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.731835 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769cdd3-3d9e-4929-bd7d-ad6cfacdf51e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.732249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769cdd3-3d9e-4929-bd7d-ad6cfacdf51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.747249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:48.747855 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.748135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.748410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.750194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:48.751899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b769cdd3-3d9e-4929-bd7d-ad6cfacdf51e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:48.753039 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b769cdd3-3d9e-4929-bd7d-ad6cfacdf51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:48.797390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:48.802649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:48.811689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:48.813315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:48.816757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1201/2419] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:48.823304 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1219/2420] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:24:48.825615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.825931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.826209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.851562 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:48.852768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:48.861045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1202/2421] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:48.866682 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.877513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54232430-2ca8-4e6c-91b9-30c18eede219 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:48.882300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:48.882899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.883188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.883491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.885230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:48.885230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:48.886275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:48.901815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1220/2422] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:24:48.903433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.912829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf7be-8377-4a28-b16c-09b2f7fd5081 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:48.917481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:48.918102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:48.918647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:48.918917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:48.919533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:48.921417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:48.953316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1203/2423] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:48 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:48.954952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:48.964792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c810f7-6dc4-4b8f-bd71-33e3db47b2d8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:49.028890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:49.029500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:49.029780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:49.030084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:49.030727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:49.032663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:49.053610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1221/2424] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:48 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:49.058769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:49.072185 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6bd13-2941-4027-a98b-1f881ffdd51b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:49.076942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:49.077547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:49.077819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:49.078115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:49.078793 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:49.080396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:49.091353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1204/2425] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:49.095569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:49.107362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe0882-298f-4c44-93d5-2e06b0ded946 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:49.112688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71bc6b-4eb9-440a-a38c-8de403e919c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:49.113297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bc6b-4eb9-440a-a38c-8de403e919c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:49.113610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bc6b-4eb9-440a-a38c-8de403e919c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:49.113921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71bc6b-4eb9-440a-a38c-8de403e919c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:49.114624 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71bc6b-4eb9-440a-a38c-8de403e919c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:49.116235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71bc6b-4eb9-440a-a38c-8de403e919c4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:49.127516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1222/2426] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:49.132435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:49.142611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c6f8-c7ce-4d3a-acec-970ba5f59f29 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:49.147751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:49.148389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:49.148667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:49.148937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] PATH_INFO: `/v3/projects/bb6e5312ca7c4188b95dcab2a6edc7c6/users/046c0674004e4747b4a365f26a5b8f5c/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:49.163942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6e5312ca7c4188b95dcab2a6edc7c6, user_id=046c0674004e4747b4a365f26a5b8f5c, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:49.166636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:49.184049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1205/2427] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:49 2022] PUT /identity/v3/projects/bb6e5312ca7c4188b95dcab2a6edc7c6/users/046c0674004e4747b4a365f26a5b8f5c/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:49.189227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0fe36-7496-4198-9474-c1907cd9e5ee None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:49.189516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0fe36-7496-4198-9474-c1907cd9e5ee None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:49.189792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0fe36-7496-4198-9474-c1907cd9e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:49.210071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bcd0fe36-7496-4198-9474-c1907cd9e5ee None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:49.211188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bcd0fe36-7496-4198-9474-c1907cd9e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:49.274997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1223/2428] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:49.284673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:49.286413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:49.342204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ea1e-5c52-4e75-ba80-f25de9155d32 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:49.345870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:49.346463 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:49.346747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:49.347022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:49.355762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:49.357184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:49.366430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1206/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:53.875719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:53.876159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:53.876272 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:53.912068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] MFA Rules not processed for user `046c0674004e4747b4a365f26a5b8f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:53.913363 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:53.976874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:54.003061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1224/2430] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:54.008687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:54.019248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43df9-87ec-48da-b06c-e1a90092dc0f service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:54.024135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:54.024814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:54.025166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:54.025501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:54.026249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:54.028440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:54.059694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1207/2431] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:54 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:54.063511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:54.074879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaab0b-6657-4cc0-b1bd-65c42141795f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:54.153614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:54.154466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:54.154836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:54.155198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:54.156156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:54.158709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:54.192698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1225/2432] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:54 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:54.193696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:54.208507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5048f5-8b1e-4d4d-8d74-083d7abd9e5b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:54.213526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:54.214188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:54.214461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:54.214877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:54.215530 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:54.217132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:54.240949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1208/2433] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:54.245113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:54.257431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4173319-d2bd-48ee-a5d8-84aa3982ada6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:54.262709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:54.263457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:54.263803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:54.264142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] PATH_INFO: `/v3/projects/04f617f4468f420aaf76266d3282c5b4/users/3e72de44bebe4df5843343ed0ae7b42e/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:54.316860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f617f4468f420aaf76266d3282c5b4, user_id=3e72de44bebe4df5843343ed0ae7b42e, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:54.322642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:54.342803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1226/2434] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:54 2022] PUT /identity/v3/projects/04f617f4468f420aaf76266d3282c5b4/users/3e72de44bebe4df5843343ed0ae7b42e/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:54.346521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:54.366590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b452-7326-4bcb-ab38-e716f7cc1ca6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:54.433300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342624a-4d2b-4958-84c0-8d2adfe6e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:54.434038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342624a-4d2b-4958-84c0-8d2adfe6e657 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:54.434424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342624a-4d2b-4958-84c0-8d2adfe6e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:54.434764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342624a-4d2b-4958-84c0-8d2adfe6e657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:54.435474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342624a-4d2b-4958-84c0-8d2adfe6e657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:54.437317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342624a-4d2b-4958-84c0-8d2adfe6e657 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:54.440007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:54.460300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:54.461636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1209/2435] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:54.473870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931215eb-7a47-4135-ad44-69035d6cacaf admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:54.478778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:54.479303 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:54.479586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:54.479937 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] PATH_INFO: `/v3/projects/04f617f4468f420aaf76266d3282c5b4/users/3e72de44bebe4df5843343ed0ae7b42e/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:54.482607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f617f4468f420aaf76266d3282c5b4, user_id=3e72de44bebe4df5843343ed0ae7b42e, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:54.485374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:54.500276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1227/2436] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:54 2022] PUT /identity/v3/projects/04f617f4468f420aaf76266d3282c5b4/users/3e72de44bebe4df5843343ed0ae7b42e/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:56.257746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f88aa-cf04-4190-9697-25a01c0ba7e8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:56.258262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f88aa-cf04-4190-9697-25a01c0ba7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:56.258262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f88aa-cf04-4190-9697-25a01c0ba7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:56.286410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f95f88aa-cf04-4190-9697-25a01c0ba7e8 None None] MFA Rules not processed for user `3f519b1d9a1149169b8142e738320a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:56.287678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f95f88aa-cf04-4190-9697-25a01c0ba7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:56.363874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1210/2437] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:24:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:57.015126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:57.079932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e81078-6197-421b-9a34-2634bb305a89 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:57.083894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:57.084744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:57.084863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:57.085076 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:57.087074 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:57.098666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:57.100109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:57.110736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1228/2438] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:00.403769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebc34e-2421-40c3-9efd-cdff20a98cd0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:00.404279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebc34e-2421-40c3-9efd-cdff20a98cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:00.404574 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebc34e-2421-40c3-9efd-cdff20a98cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:00.452790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2cebc34e-2421-40c3-9efd-cdff20a98cd0 None None] MFA Rules not processed for user `3e72de44bebe4df5843343ed0ae7b42e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:00.454486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2cebc34e-2421-40c3-9efd-cdff20a98cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:00.541205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1211/2439] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:00.556691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:00.559940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:00.617548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:00.691372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a217f0c-51f5-4436-9182-98941cf8fef4 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:00.702054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:00.704070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:00.704591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:00.705075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:00.788262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:00.790332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:00.802072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1229/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:02.221566 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:02.222166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:02.222797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:02.242781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] MFA Rules not processed for user `046c0674004e4747b4a365f26a5b8f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:02.244031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:02.256802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1212/2441] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:10.796050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=38 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:12.236679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=63 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:21.805413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:21.818446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391080e-22f4-4d01-b1e5-f4811c0fbb86 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:21.824110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:21.824720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:21.825000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:21.825281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:21.827080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:21.840822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:21.842743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:21.854311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1230/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:29.345909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:29.347320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:29.359077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e021c-f253-45a3-ab3e-c40bd6f5ddbc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:29.363120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:29.363715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:29.363998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:29.364267 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:29.365955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:29.426910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:29.428370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:29.437986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1213/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:31.850230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:32.665662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:32.667661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:32.689801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f4f14-4482-4eff-a4e9-57ef714e739c service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:32.691632 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:32.692269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:32.692548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:32.692825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] PATH_INFO: `/v3/users/c924dfe7e9c941f9b7110c1a440633dc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:32.693969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c924dfe7e9c941f9b7110c1a440633dc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:32.695916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:32.743536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c924dfe7e9c941f9b7110c1a440633dc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:32.751077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c924dfe7e9c941f9b7110c1a440633dc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:32.763138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c924dfe7e9c941f9b7110c1a440633dc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:32.763775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c924dfe7e9c941f9b7110c1a440633dc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:32.770562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2f0f25be-58e5-4106-b1cc-2bd457cc87f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c924dfe7e9c941f9b7110c1a440633dc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:32.776302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1231/2444] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:32 2022] DELETE /identity/v3/users/c924dfe7e9c941f9b7110c1a440633dc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:32.962379 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:32.975517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad7f96-7322-48d7-b27c-9c59450061ad service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.053363 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.054098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.054376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.054670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] PATH_INFO: `/v3/projects/0043c999ad9d451ab45c19cbea1765ea` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.055878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0043c999ad9d451ab45c19cbea1765ea)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.057674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.104485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0043c999ad9d451ab45c19cbea1765ea', 'request_id': 'req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:33.110782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0043c999ad9d451ab45c19cbea1765ea', 'request_id': 'req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:33.116381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0043c999ad9d451ab45c19cbea1765ea', 'request_id': 'req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:33.130662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] The token cache is being invalidate because project 0043c999ad9d451ab45c19cbea1765ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:33.130953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:33.131587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a8df3b54-ecbf-4d74-a9f0-f88b2e7e58b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:33.133064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1214/2445] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:32 2022] DELETE /identity/v3/projects/0043c999ad9d451ab45c19cbea1765ea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:25:33.138016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.138493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.138592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.159316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:33.160515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:33.224926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1232/2446] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:33.231577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.231866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.232365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.253197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:33.254451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:33.265492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1215/2447] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:33.266911 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.277160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279462ee-c337-4918-b6bb-3f0e88863d10 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.281687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.282361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.282641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.282913 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.283621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:33.283921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.285546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.297754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1233/2448] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:25:33.302921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.312517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3a94-ef27-415d-aa42-29db94720884 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.317568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.318200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.318474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.318742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.319374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.321299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.337696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:33.351651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1216/2449] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:33 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:33.355921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.365772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4176a2-d30d-464b-bf48-b939c32e17e9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.421736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.422373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.422656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.422932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.423574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.425532 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.433351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:33.448525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1234/2450] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:33 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:33.452799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.463060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6885f0-365f-4b86-965c-39dc4f2aa204 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.467709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.468329 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.468608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.468879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.469518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.471726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.481507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1217/2451] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:33.486167 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.498916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7f631-25d0-476b-9d1b-674835769c26 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.504237 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4e32-3879-4379-acc8-7da4a43326b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.504837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4e32-3879-4379-acc8-7da4a43326b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.505113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4e32-3879-4379-acc8-7da4a43326b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.505383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4e32-3879-4379-acc8-7da4a43326b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.506056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf4e32-3879-4379-acc8-7da4a43326b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.507652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf4e32-3879-4379-acc8-7da4a43326b3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.518832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1235/2452] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:33.523044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.532873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a8f94-77f8-4d47-bde8-5fe5bb99d908 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.537683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.538350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.538629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.538922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] PATH_INFO: `/v3/projects/8f133f3096eb472d9a3c98ea9b81c1b9/users/988168279e8e495a985e209a35764f2b/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.553255 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f133f3096eb472d9a3c98ea9b81c1b9, user_id=988168279e8e495a985e209a35764f2b, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.555921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.568921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1218/2453] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:33 2022] PUT /identity/v3/projects/8f133f3096eb472d9a3c98ea9b81c1b9/users/988168279e8e495a985e209a35764f2b/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:33.573999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ffce9-b94d-450d-b863-4abe06895027 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.574309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ffce9-b94d-450d-b863-4abe06895027 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.574609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ffce9-b94d-450d-b863-4abe06895027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.594132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-866ffce9-b94d-450d-b863-4abe06895027 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:33.595326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-866ffce9-b94d-450d-b863-4abe06895027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:33.653238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1236/2454] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:33.662981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:33.664726 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:33.721386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d552-4506-4568-b514-29abf8b35cf2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:33.724918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:33.725511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:33.725788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:33.726097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:33.735004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:33.736952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:33.746284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1219/2455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:38.444443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd4d74-bf49-424b-9911-3493095b07e9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:38.444918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd4d74-bf49-424b-9911-3493095b07e9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:38.445437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd4d74-bf49-424b-9911-3493095b07e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:38.487634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-00fd4d74-bf49-424b-9911-3493095b07e9 None None] MFA Rules not processed for user `988168279e8e495a985e209a35764f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:38.489060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-00fd4d74-bf49-424b-9911-3493095b07e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:38.565902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1237/2456] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:38.579759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:38.581680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:38.678679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bebe90-5288-4841-b10e-05917d102ad5 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:38.684169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:38.684767 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:38.685042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:38.685311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:38.694065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:38.696909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:38.709017 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1220/2457] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:40.126398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d4505-a7ba-4015-81e1-14c93553c440 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:40.126847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d4505-a7ba-4015-81e1-14c93553c440 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:40.127360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d4505-a7ba-4015-81e1-14c93553c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:40.150187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-405d4505-a7ba-4015-81e1-14c93553c440 None None] MFA Rules not processed for user `988168279e8e495a985e209a35764f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:40.151400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-405d4505-a7ba-4015-81e1-14c93553c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:40.159284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1238/2458] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:40.847321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:40.850397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:40.898439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25adb-cc81-499e-9ff0-00cf72076b53 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:40.914063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:40.915069 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:40.915231 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:40.915510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:40.917668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:40.999806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:41.030962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:41.032551 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af0d63-f158-4329-8386-e137bcaae91e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:41.044352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1221/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:50.143790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:51.038824 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:52.777946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.778413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.778530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.797020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] MFA Rules not processed for user `5d8054341c0e46778e3b3db0b3dd1164`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:52.798380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:52.864119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1239/2460] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:25:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:58.247489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc641-8bd7-4c8e-ac9f-ec2517b55102 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.248022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc641-8bd7-4c8e-ac9f-ec2517b55102 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.248129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc641-8bd7-4c8e-ac9f-ec2517b55102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.273536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b80fc641-8bd7-4c8e-ac9f-ec2517b55102 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:58.274872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b80fc641-8bd7-4c8e-ac9f-ec2517b55102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:58.330869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1222/2461] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:58.379692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:58.381181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:58.469055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3f366-1e56-4dd6-b7bf-8254eedb8fbf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:58.474156 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:58.474774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:58.475052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:58.475321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:58.483749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:58.486403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:58.495105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1240/2462] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:08.323738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=25 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:08.491711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=57 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:18.025715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e822-f202-4ad2-82cd-af5bd6a24289 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:18.026234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e822-f202-4ad2-82cd-af5bd6a24289 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:18.026331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e822-f202-4ad2-82cd-af5bd6a24289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:18.044865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6a21e822-f202-4ad2-82cd-af5bd6a24289 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:18.046070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6a21e822-f202-4ad2-82cd-af5bd6a24289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:18.053473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1223/2463] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:26:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:18.065594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:18.075979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e67c-1477-4db8-a6bc-b6eec5340832 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:18.081050 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:18.081645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:18.081965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:18.082240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:18.090352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:18.091946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:18.100466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1241/2464] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:28.039390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:28.096796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:37.912469 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:37.912951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:37.913068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:37.931746 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:37.933018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:37.940803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1224/2465] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 00:26:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:37.955035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:37.965295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4155-1b61-40ae-9978-0bdcaf5da7bf service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:37.970578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:37.971189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:37.971542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:37.971880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:37.980185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:37.981760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:37.990431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1242/2466] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:47.926528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:47.986876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:48.068430 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:48.078044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62e7f-71cc-4d60-8e93-0b2ad854aa93 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:48.081641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:48.082307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.082586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.082893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.084635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:48.096399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:48.097808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:48.107077 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1225/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:51.252705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.254180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.329175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.331168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.332522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc8f6-0b99-46d8-8312-4f034d8487fe service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.337561 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.338211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.338497 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.338771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.340517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.349913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4c40-c9aa-496f-9c56-a13bc756c6cf service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.352228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.353821 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.354707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.355393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.355736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.356113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] PATH_INFO: `/v3/users/3f519b1d9a1149169b8142e738320a89` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.357510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f519b1d9a1149169b8142e738320a89)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.359715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.368629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1243/2468] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:51.408548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f519b1d9a1149169b8142e738320a89'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.409217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f519b1d9a1149169b8142e738320a89'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.409825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f519b1d9a1149169b8142e738320a89'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.422091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f519b1d9a1149169b8142e738320a89'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.429219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1a76975a-3162-4d8e-841b-0f1f2bafd71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f519b1d9a1149169b8142e738320a89'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.441758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1226/2469] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:51 2022] DELETE /identity/v3/users/3f519b1d9a1149169b8142e738320a89 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:51.614252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.625277 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ec040-301f-4cf9-98a5-08a3476485b9 service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.680914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.681533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.681808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.682100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] PATH_INFO: `/v3/projects/74bc2aed79de4b3d92d19ef9bf26cc51` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.683195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bc2aed79de4b3d92d19ef9bf26cc51)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.685099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.729747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bc2aed79de4b3d92d19ef9bf26cc51', 'request_id': 'req-5bb06042-c398-4d48-8417-248afb207ffb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.735692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bc2aed79de4b3d92d19ef9bf26cc51', 'request_id': 'req-5bb06042-c398-4d48-8417-248afb207ffb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.741047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bc2aed79de4b3d92d19ef9bf26cc51', 'request_id': 'req-5bb06042-c398-4d48-8417-248afb207ffb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.752450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] The token cache is being invalidate because project 74bc2aed79de4b3d92d19ef9bf26cc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:51.752739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.753353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bb06042-c398-4d48-8417-248afb207ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.754850 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1244/2470] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:51 2022] DELETE /identity/v3/projects/74bc2aed79de4b3d92d19ef9bf26cc51 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:51.759794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.760176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.760450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.780099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:51.781288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.838411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1227/2471] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:51.846316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.846602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.846879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.870084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:51.871262 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.879627 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1245/2472] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:51.883937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.893641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b20be-7ede-45ff-9cbc-9b13a805859e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.898165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.898751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.899028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.899306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.899943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:51.900242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.901950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.913018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1228/2473] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:26:51.917417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.927072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47b66-b8ca-4bc7-a3aa-c5fba659a8ee None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.931703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.932286 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.932564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.932832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.933534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.936082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.947060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.964029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1246/2474] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:51.968252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.978247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba178d-aa14-4885-b175-d59ea8cd93ab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.023492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:52.036929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.037535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.037814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.038130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.039097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.041429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.062382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1229/2475] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:52.066569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.076759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3abf-b572-42e0-8e74-96406eab12de admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.081249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.081833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.082150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.082420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.083052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.084659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.095243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1247/2476] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:52.099008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.109520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0000975-bbdf-485b-b344-01d4f94b4ba3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.114177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33fc20-e799-4c66-a8b2-29c863a3cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.114760 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33fc20-e799-4c66-a8b2-29c863a3cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.115040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33fc20-e799-4c66-a8b2-29c863a3cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.115310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33fc20-e799-4c66-a8b2-29c863a3cb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.115948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33fc20-e799-4c66-a8b2-29c863a3cb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.117540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33fc20-e799-4c66-a8b2-29c863a3cb3e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.128475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1230/2477] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:52.132355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.142146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e436c0f-095b-4369-b952-f5376b68e7ed admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.146686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.147317 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.147592 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.147864 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] PATH_INFO: `/v3/projects/3becf466afb44c1cb955f48273d2b101/users/e1aed8f5592040628d9faa7d1c72f254/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.162719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3becf466afb44c1cb955f48273d2b101, user_id=e1aed8f5592040628d9faa7d1c72f254, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.165378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.182776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1248/2478] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:52 2022] PUT /identity/v3/projects/3becf466afb44c1cb955f48273d2b101/users/e1aed8f5592040628d9faa7d1c72f254/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:52.194471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.194759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.195132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.224170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] MFA Rules not processed for user `e1aed8f5592040628d9faa7d1c72f254`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:52.225425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:52.295075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1231/2479] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:26:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:52.299785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.365469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7e5b-4a25-4ae6-855b-ee9bf362d13d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.370201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.370825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.371109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.371380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.372043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.374039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.403046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1249/2480] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:52 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:52.407846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.420132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51564f6d-dc26-49a9-a547-10a31d1e2167 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.475347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.475952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.476264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.476539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.477240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.479470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.500624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1232/2481] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:52 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:52.504786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.515633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d260f-5162-4ed3-bb92-9cea1ac84f43 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.520275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.520866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.521145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.521418 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.522116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.523718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.534043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1250/2482] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:52.538072 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.548891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38560a-8f74-4844-8308-f892a987d839 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.553523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b6fc3-8272-4150-8f14-215ab99c912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.554156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6fc3-8272-4150-8f14-215ab99c912d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.554439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6fc3-8272-4150-8f14-215ab99c912d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.554716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6fc3-8272-4150-8f14-215ab99c912d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.555361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b6fc3-8272-4150-8f14-215ab99c912d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.556955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b6fc3-8272-4150-8f14-215ab99c912d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.566673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1233/2483] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:52.570859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.581301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38a12-c4ab-4847-ba5c-0862b9422781 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.585923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.586570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.586851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.587123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] PATH_INFO: `/v3/projects/dea35c76fa95498eb7abafee8958f0f5/users/8304c05982cf4620bb680e6a63533b08/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.601754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea35c76fa95498eb7abafee8958f0f5, user_id=8304c05982cf4620bb680e6a63533b08, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.604538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.617671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1251/2484] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:52 2022] PUT /identity/v3/projects/dea35c76fa95498eb7abafee8958f0f5/users/8304c05982cf4620bb680e6a63533b08/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:52.628035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.628393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.628733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.657885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] MFA Rules not processed for user `8304c05982cf4620bb680e6a63533b08`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:52.659099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:52.678908 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:52.723278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1234/2485] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:26:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:52.727827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.788780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ac24-e5ae-4516-9635-6fa504effc9f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.793748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.794374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.795212 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.795471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.796105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.798138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.809785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:52.827523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1252/2486] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:52 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:52.831811 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.842301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077a84b-3b76-460b-a02e-8e218503e6b9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.897881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.898727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.898910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.899194 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.900061 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.901958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.923563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1235/2487] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:52 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:52.927612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.938453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec331-57b4-40a2-ab65-0bcd91633913 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.943062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.943661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.943941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.944215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.944851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.946490 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.956761 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1253/2488] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:52.960710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:52.970532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab093d-567c-4f9d-9998-684e52464c7d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:52.975133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:52.975772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:52.976052 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:52.976325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] PATH_INFO: `/v3/projects/0701511e16324f66a17d11085a8825c2/users/0e65ed8be84547bd926d723b0aeedcdf/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.990434 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701511e16324f66a17d11085a8825c2, user_id=0e65ed8be84547bd926d723b0aeedcdf, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.993092 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.006642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1236/2489] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:52 2022] PUT /identity/v3/projects/0701511e16324f66a17d11085a8825c2/users/0e65ed8be84547bd926d723b0aeedcdf/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:53.010576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:53.020575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c0678-2d63-4191-aa70-c34ece01a88a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:53.078264 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b0738-2ab6-40aa-b6a4-57a2cb748636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:53.078940 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0738-2ab6-40aa-b6a4-57a2cb748636 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.079215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0738-2ab6-40aa-b6a4-57a2cb748636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.079484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0738-2ab6-40aa-b6a4-57a2cb748636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.080138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b0738-2ab6-40aa-b6a4-57a2cb748636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:53.081695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b0738-2ab6-40aa-b6a4-57a2cb748636 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.092455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1254/2490] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:53.096408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:53.106532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a766f6e-8ca5-4ec8-944d-ac63d1a41511 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:53.112106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:53.112745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.113020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.113289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] PATH_INFO: `/v3/projects/0701511e16324f66a17d11085a8825c2/users/0e65ed8be84547bd926d723b0aeedcdf/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.115203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701511e16324f66a17d11085a8825c2, user_id=0e65ed8be84547bd926d723b0aeedcdf, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:53.117839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.127940 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1237/2491] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:53 2022] PUT /identity/v3/projects/0701511e16324f66a17d11085a8825c2/users/0e65ed8be84547bd926d723b0aeedcdf/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:53.139641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.139932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.140211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.167978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] MFA Rules not processed for user `0e65ed8be84547bd926d723b0aeedcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:53.169180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:53.235380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1255/2492] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:26:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:53.245995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:53.248333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:53.313537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197080b-3bd2-479c-9117-b386f7eea06a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:53.317131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:53.317718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.318022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.318292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.327428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:53.328876 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.337942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1238/2493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:53.827126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:53.828601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:53.874608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe4454-bd5d-4e4e-a02c-162d5a25a332 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:53.878301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57297dd8-69b7-441f-b445-86c9dafd5e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:53.878906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297dd8-69b7-441f-b445-86c9dafd5e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.879182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297dd8-69b7-441f-b445-86c9dafd5e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.879453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297dd8-69b7-441f-b445-86c9dafd5e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.908815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:53.948829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297dd8-69b7-441f-b445-86c9dafd5e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:53.950301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297dd8-69b7-441f-b445-86c9dafd5e20 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.959118 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1256/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:57.974202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.986055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:57.995323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630d26d-2587-42cd-9473-41d39a50158a service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.999180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.999778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:58.000054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:58.000324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:58.058560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:58.060737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:58.070491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1239/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:58.628683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8cce-3d90-41f3-90a7-8d36be9e1dec None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:58.629202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8cce-3d90-41f3-90a7-8d36be9e1dec None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:58.629316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8cce-3d90-41f3-90a7-8d36be9e1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:58.648564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d8eb8cce-3d90-41f3-90a7-8d36be9e1dec None None] MFA Rules not processed for user `988168279e8e495a985e209a35764f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:58.649933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d8eb8cce-3d90-41f3-90a7-8d36be9e1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:58.713036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1257/2496] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:26:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:00.196428 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.286784 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614af5b-1256-4d38-851e-e56a2d6ac013 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.292054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.292671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.292946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.293215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] PATH_INFO: `/v3/users/e1aed8f5592040628d9faa7d1c72f254` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.294364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1aed8f5592040628d9faa7d1c72f254)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.296295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.341033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1aed8f5592040628d9faa7d1c72f254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:00.341678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1aed8f5592040628d9faa7d1c72f254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:00.342314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1aed8f5592040628d9faa7d1c72f254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:00.353721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1aed8f5592040628d9faa7d1c72f254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:00.360713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1aed8f5592040628d9faa7d1c72f254'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:00.362716 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:00.375860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1240/2497] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:00 2022] DELETE /identity/v3/users/e1aed8f5592040628d9faa7d1c72f254 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:00.380365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.380878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.380991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.420446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:00.421683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:00.479284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1258/2498] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:00.489360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.490820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:00.554866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6006f4-e9c2-4eaa-a49a-0e6c1141e6c8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.558535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.559132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.559414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.559689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.568585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.570048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.579812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1241/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:01.107145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:01.108639 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:01.123177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cce34-352e-4315-be91-712d72a5b2b9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:01.128441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:01.129113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:01.129393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:01.129666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] PATH_INFO: `/v3/projects/3becf466afb44c1cb955f48273d2b101` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:01.131085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3becf466afb44c1cb955f48273d2b101)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:01.133021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:01.177928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:01.185629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3becf466afb44c1cb955f48273d2b101', 'request_id': 'req-27655df6-93f8-425b-a72f-d7870acb6691'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.192045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3becf466afb44c1cb955f48273d2b101', 'request_id': 'req-27655df6-93f8-425b-a72f-d7870acb6691'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.197677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3becf466afb44c1cb955f48273d2b101', 'request_id': 'req-27655df6-93f8-425b-a72f-d7870acb6691'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.211439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] The token cache is being invalidate because project 3becf466afb44c1cb955f48273d2b101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:01.211745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.212417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.214033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1259/2500] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:01 2022] DELETE /identity/v3/projects/3becf466afb44c1cb955f48273d2b101 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:01.218617 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:01.228807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738938b6-349f-4345-ab67-617048c6a5a4 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:01.294133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:01.294827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:01.295101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:01.295398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] PATH_INFO: `/v3/users/8304c05982cf4620bb680e6a63533b08` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:01.296666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8304c05982cf4620bb680e6a63533b08)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:01.298901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:01.345721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8304c05982cf4620bb680e6a63533b08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.346451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8304c05982cf4620bb680e6a63533b08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.347166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8304c05982cf4620bb680e6a63533b08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.359090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8304c05982cf4620bb680e6a63533b08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.366547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8304c05982cf4620bb680e6a63533b08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.379645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1242/2501] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:01 2022] DELETE /identity/v3/users/8304c05982cf4620bb680e6a63533b08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:01.879342 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:01.880917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:01.894800 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27655df6-93f8-425b-a72f-d7870acb6691 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:01.960086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:01.960726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:01.961008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:01.961285 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] PATH_INFO: `/v3/projects/dea35c76fa95498eb7abafee8958f0f5` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:01.962536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea35c76fa95498eb7abafee8958f0f5)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:01.964457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.012522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea35c76fa95498eb7abafee8958f0f5', 'request_id': 'req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.019068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea35c76fa95498eb7abafee8958f0f5', 'request_id': 'req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.024922 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea35c76fa95498eb7abafee8958f0f5', 'request_id': 'req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.038197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] The token cache is being invalidate because project dea35c76fa95498eb7abafee8958f0f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:02.038484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.039102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.040887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1260/2502] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:01 2022] DELETE /identity/v3/projects/dea35c76fa95498eb7abafee8958f0f5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:02.045422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.046863 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.060338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b330e4d-3472-46ee-b64e-bf2e5e5f4b99 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.069405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:02.122745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.123384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.123662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.123952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] PATH_INFO: `/v3/users/0e65ed8be84547bd926d723b0aeedcdf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.125063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e65ed8be84547bd926d723b0aeedcdf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:02.127034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.175406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e65ed8be84547bd926d723b0aeedcdf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.176260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e65ed8be84547bd926d723b0aeedcdf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.176735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e65ed8be84547bd926d723b0aeedcdf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.191223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e65ed8be84547bd926d723b0aeedcdf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.198543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-89f225ae-c3e1-4f21-b8b1-d09945c4cf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e65ed8be84547bd926d723b0aeedcdf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.212093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1243/2503] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:02 2022] DELETE /identity/v3/users/0e65ed8be84547bd926d723b0aeedcdf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:02.507415 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.509218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.522960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caacec-4b31-40ed-ab9f-1e1da63ed6a6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.580959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.581595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.581899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.582177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] PATH_INFO: `/v3/projects/0701511e16324f66a17d11085a8825c2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.583306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0701511e16324f66a17d11085a8825c2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:02.585228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.586718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:02.636686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0701511e16324f66a17d11085a8825c2', 'request_id': 'req-a1164f14-43e3-40a4-94e5-b7bba29fda2a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.643354 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0701511e16324f66a17d11085a8825c2', 'request_id': 'req-a1164f14-43e3-40a4-94e5-b7bba29fda2a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.649030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0701511e16324f66a17d11085a8825c2', 'request_id': 'req-a1164f14-43e3-40a4-94e5-b7bba29fda2a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.662570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] The token cache is being invalidate because project 0701511e16324f66a17d11085a8825c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:02.662857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.663512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a1164f14-43e3-40a4-94e5-b7bba29fda2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.665011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1261/2504] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:02 2022] DELETE /identity/v3/projects/0701511e16324f66a17d11085a8825c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:02.671668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.672107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.672203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.722227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:02.723850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.789818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1244/2505] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:02.798694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.799082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.799430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.824266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:02.826280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.834896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1262/2506] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:02.839159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.849545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7b15-f9ec-4885-8276-003cdd8d6d20 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.859613 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.860598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.861081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.861454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.862160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:02.862471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:02.868821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.871798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:02.886192 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1245/2507] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:02.890901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.901137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27aea0-0fc6-489e-8e60-886427702901 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.907879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.908778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.909281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.909617 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.910804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:02.912412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.942689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1263/2508] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:02 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:02.946968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.957909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a646-402f-4114-a19d-3747a00eaddc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.023721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.024327 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.024623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.024890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.025527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.027513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.052889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1246/2509] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:02 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:03.054963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.067569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629171b-a674-4de0-8db5-6b35710d2c0f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.073015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.073824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.074238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.074691 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.075608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.078195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.088281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1264/2510] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:03.092285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.102488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3527c-7a94-4440-956b-1c3abeab2f71 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.107692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419306d8-3177-4b40-8f71-1b7d2d675a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.108285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419306d8-3177-4b40-8f71-1b7d2d675a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.108567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419306d8-3177-4b40-8f71-1b7d2d675a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.108840 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419306d8-3177-4b40-8f71-1b7d2d675a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.109479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419306d8-3177-4b40-8f71-1b7d2d675a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.111128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419306d8-3177-4b40-8f71-1b7d2d675a43 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.121358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1247/2511] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:03.126226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.136485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e77c0-c419-43bb-8a40-d62eb4365fb7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.141645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.142325 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.142600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.142870 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] PATH_INFO: `/v3/projects/e13ff31d8687443cb670a07aa63c2ebf/users/1531649dfd8a486d9038cce92cb24eee/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.157898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13ff31d8687443cb670a07aa63c2ebf, user_id=1531649dfd8a486d9038cce92cb24eee, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.160670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.173828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1265/2512] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:03 2022] PUT /identity/v3/projects/e13ff31d8687443cb670a07aa63c2ebf/users/1531649dfd8a486d9038cce92cb24eee/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:03.185466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.185750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.186060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.214279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] MFA Rules not processed for user `1531649dfd8a486d9038cce92cb24eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:03.215484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.282328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1248/2513] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:03.286936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.351894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85330b25-b3ef-4f5c-b032-a671af32a654 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.357666 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.358313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.358595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.358889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.359514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.361449 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.394609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1266/2514] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:03 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:03.398557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.410126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4c6c2-779c-42d1-a197-c68bd2cc6c09 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.468827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.469435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.469713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.470031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.470657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.472592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.482556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:03.496227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1249/2515] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:03 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:03.500956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.511876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b6695-e42e-4142-81c5-c01e0184a1a0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.517202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.517802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.518106 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.518378 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.519017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.520621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.525885 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:03.532384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1267/2516] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:03.536412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.546636 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8decd-1dc9-4ea5-945f-6395d5451e5f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.551215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.551860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.552136 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.552406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] PATH_INFO: `/v3/projects/2dfe67fbc50940dab18bc770ff78486f/users/a5e31b2ba5ab4e8d869a6674616bc6f4/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.567507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfe67fbc50940dab18bc770ff78486f, user_id=a5e31b2ba5ab4e8d869a6674616bc6f4, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.570223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.584837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1250/2517] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:03 2022] PUT /identity/v3/projects/2dfe67fbc50940dab18bc770ff78486f/users/a5e31b2ba5ab4e8d869a6674616bc6f4/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:03.589657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.599773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47bad-b1c8-4509-9df7-ca2f71287956 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.655520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10826c-676c-4548-9b56-660681bd0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.656036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10826c-676c-4548-9b56-660681bd0e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.656312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10826c-676c-4548-9b56-660681bd0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.656578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10826c-676c-4548-9b56-660681bd0e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.657208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10826c-676c-4548-9b56-660681bd0e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.658947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10826c-676c-4548-9b56-660681bd0e0e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.668923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1268/2518] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:03.673675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.684403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b7755-dd87-42cd-9717-fb70ca347916 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.689667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.690351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.690632 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.690905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] PATH_INFO: `/v3/projects/2dfe67fbc50940dab18bc770ff78486f/users/a5e31b2ba5ab4e8d869a6674616bc6f4/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.692831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfe67fbc50940dab18bc770ff78486f, user_id=a5e31b2ba5ab4e8d869a6674616bc6f4, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.695520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.705704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1251/2519] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:03 2022] PUT /identity/v3/projects/2dfe67fbc50940dab18bc770ff78486f/users/a5e31b2ba5ab4e8d869a6674616bc6f4/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:03.717159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.717441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.717716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.748124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] MFA Rules not processed for user `a5e31b2ba5ab4e8d869a6674616bc6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:03.749343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.816834 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1269/2520] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:03.828424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.830171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.890556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58fb03-49ac-4bd5-845c-55d14773ba5c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.894253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.894858 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.895137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.895415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.905186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.906708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.916176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1252/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:04.021745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:04.031736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95807b00-10b9-40f7-b304-85637205e1ae None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:04.035437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7913-c833-4bc1-8429-334f15506d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:04.036040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7913-c833-4bc1-8429-334f15506d6a service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.036322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7913-c833-4bc1-8429-334f15506d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.036596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7913-c833-4bc1-8429-334f15506d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.095511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7913-c833-4bc1-8429-334f15506d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:04.096983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7913-c833-4bc1-8429-334f15506d6a service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:04.105812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1270/2522] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:06.693871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.761761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f29f-222a-47c3-85c6-a3ce202ba6fa service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.766890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.767507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.767780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.768049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] PATH_INFO: `/v3/users/1531649dfd8a486d9038cce92cb24eee` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.769181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1531649dfd8a486d9038cce92cb24eee)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.771142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.816416 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1531649dfd8a486d9038cce92cb24eee'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.817064 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1531649dfd8a486d9038cce92cb24eee'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.817698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1531649dfd8a486d9038cce92cb24eee'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.828459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.831097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1531649dfd8a486d9038cce92cb24eee'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.839567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1531649dfd8a486d9038cce92cb24eee'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.853533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1253/2523] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:06 2022] DELETE /identity/v3/users/1531649dfd8a486d9038cce92cb24eee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:06.860772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.861244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.861365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.880199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:06.881391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.893974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.941229 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1271/2524] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:06.951396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.952769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.016488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32341f-2288-4954-bdef-d1edeb968968 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.020187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.020790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.021070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.021346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.030341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.031769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.041713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1254/2525] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:07.307956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.309957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.322096 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0dea5-2a2c-44d1-8bee-d5e7817811a4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.326889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.327791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.328375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.328375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] PATH_INFO: `/v3/projects/e13ff31d8687443cb670a07aa63c2ebf` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.329443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13ff31d8687443cb670a07aa63c2ebf)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.331398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.381114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13ff31d8687443cb670a07aa63c2ebf', 'request_id': 'req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.388064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13ff31d8687443cb670a07aa63c2ebf', 'request_id': 'req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.393604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13ff31d8687443cb670a07aa63c2ebf', 'request_id': 'req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.406312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] The token cache is being invalidate because project e13ff31d8687443cb670a07aa63c2ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:07.406618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.407225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.408736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1272/2526] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/projects/e13ff31d8687443cb670a07aa63c2ebf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.412773 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.422845 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98097f-0a3c-4e64-9af2-eaad20d49b4c service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.486319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.486961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.487388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.487676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] PATH_INFO: `/v3/users/a5e31b2ba5ab4e8d869a6674616bc6f4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.488816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e31b2ba5ab4e8d869a6674616bc6f4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.491072 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.548864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e31b2ba5ab4e8d869a6674616bc6f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.549586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e31b2ba5ab4e8d869a6674616bc6f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.550757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e31b2ba5ab4e8d869a6674616bc6f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.564119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e31b2ba5ab4e8d869a6674616bc6f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.572425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-740195bf-0492-413e-8754-c36a6aa4f93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e31b2ba5ab4e8d869a6674616bc6f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.583720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.589693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1255/2527] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/users/a5e31b2ba5ab4e8d869a6674616bc6f4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.888146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.889614 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.902486 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2818c-2cf3-4bf9-9eb5-4c2a11f17f23 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.960916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.961545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.961822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.962132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] PATH_INFO: `/v3/projects/2dfe67fbc50940dab18bc770ff78486f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.963275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfe67fbc50940dab18bc770ff78486f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.965206 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.011651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.015380 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfe67fbc50940dab18bc770ff78486f', 'request_id': 'req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.022968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfe67fbc50940dab18bc770ff78486f', 'request_id': 'req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.032730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfe67fbc50940dab18bc770ff78486f', 'request_id': 'req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.046893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] The token cache is being invalidate because project 2dfe67fbc50940dab18bc770ff78486f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:08.047180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.047802 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f9c4eb2c-cc6b-4e84-abf0-6f8f0dd2fece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.049302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1273/2528] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/projects/2dfe67fbc50940dab18bc770ff78486f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.054268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.054737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.054859 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.074102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.075289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.133757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1256/2529] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:08.142180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.142465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.142737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.162068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.163364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.172450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1274/2530] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:08.176755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.193518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc34c70-a7b7-46e3-a9f3-fcb51dc62ba6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.198646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.199257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.199534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.199805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.200458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:08.200759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.202388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.218126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1257/2531] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:08.220001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.229673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010a72-dfb1-4143-a6e5-7b12e7a0225d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.235028 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.235628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.235910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.236181 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.236849 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.238897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.271781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1275/2532] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.275932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.290258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e63909-560c-437b-be64-4cecb3452fee admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.347500 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.348099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.348375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.348644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.349265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.351206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.374302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1258/2533] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.378355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.389024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94732c2-f338-4d8f-bbcc-f932baa5324e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.393628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.394252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.394531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.394824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.395461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.397058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.411349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1276/2534] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:08.412790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.422967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58e36-ccae-4155-89b5-cbea737c5533 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.427515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5c338-e217-4cc3-b7c7-fc565455ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.428102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c338-e217-4cc3-b7c7-fc565455ac62 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.428374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c338-e217-4cc3-b7c7-fc565455ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.428641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5c338-e217-4cc3-b7c7-fc565455ac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.429273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5c338-e217-4cc3-b7c7-fc565455ac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.430896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5c338-e217-4cc3-b7c7-fc565455ac62 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.441138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1259/2535] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.445112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.455522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af0ae-20aa-41bd-9bc5-43441758231e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.460056 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.460693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.460970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.461243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] PATH_INFO: `/v3/projects/278dcf6eaeeb4aa090a88de57c945387/users/fc2a61901021445da7ee7557648fc9e2/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.475257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278dcf6eaeeb4aa090a88de57c945387, user_id=fc2a61901021445da7ee7557648fc9e2, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.477978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.491330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1277/2536] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/278dcf6eaeeb4aa090a88de57c945387/users/fc2a61901021445da7ee7557648fc9e2/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.502753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.503035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.503308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.530483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] MFA Rules not processed for user `fc2a61901021445da7ee7557648fc9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.531610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.585526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.596178 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1260/2537] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:08.600583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.661375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432fc2-93b6-4449-9d0a-067c477b26c6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.666673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.667279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.667557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.667828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.668465 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.671136 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.701138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1278/2538] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.702295 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.713397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223643-5a99-46d9-a49e-954ef29802d5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.774904 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.775410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.775689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.775964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.776604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.779218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.805369 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1261/2539] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:08.806407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.817872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c27d4-1c78-4aaa-afce-722a34302839 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.822839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.823520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.823895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.824174 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.824817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.826562 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.837337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1279/2540] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:08.842000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.851736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f26dc-1a8d-42cf-ad26-5ee10924093e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.856273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.857488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.857765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.858065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] PATH_INFO: `/v3/projects/201e293938ae45b696df7cbb2011e7f5/users/f22f5e207ff544209d00918ec3f319ba/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.874454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] RBAC: Authorizing `identity:create_grant(project_id=201e293938ae45b696df7cbb2011e7f5, user_id=f22f5e207ff544209d00918ec3f319ba, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.877116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.890367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1262/2541] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/201e293938ae45b696df7cbb2011e7f5/users/f22f5e207ff544209d00918ec3f319ba/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.894302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.904844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dc17c-d04f-4394-9d48-b97a8dd15c4f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.946189 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.963306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3ba95-c660-4979-972d-637f2106fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.963909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3ba95-c660-4979-972d-637f2106fabc admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.964213 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3ba95-c660-4979-972d-637f2106fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.964488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3ba95-c660-4979-972d-637f2106fabc admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.965123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3ba95-c660-4979-972d-637f2106fabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.966855 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3ba95-c660-4979-972d-637f2106fabc admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.976475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1280/2542] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.980683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.991521 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7d7ec-5bca-4184-a2e2-9159626d078a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.996056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.996695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.997511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.997821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] PATH_INFO: `/v3/projects/201e293938ae45b696df7cbb2011e7f5/users/f22f5e207ff544209d00918ec3f319ba/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.999751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201e293938ae45b696df7cbb2011e7f5, user_id=f22f5e207ff544209d00918ec3f319ba, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.002406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.012090 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1263/2543] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/201e293938ae45b696df7cbb2011e7f5/users/f22f5e207ff544209d00918ec3f319ba/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:09.022315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.022613 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.022869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.050267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] MFA Rules not processed for user `f22f5e207ff544209d00918ec3f319ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:09.051383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.117804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1281/2544] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:09.128549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.130246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.186829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58077917-7f7e-4e4d-b799-4e414caa4707 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.190425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.191013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.191472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.191756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.245741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.248322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.256990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1264/2545] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:13.476662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.478163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.490644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488df55-64b5-4621-a2b6-d7544a36e3d3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.495190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea574239-8ad4-434b-ac3d-26f9acc34f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.495718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea574239-8ad4-434b-ac3d-26f9acc34f78 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.496070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea574239-8ad4-434b-ac3d-26f9acc34f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.496403 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea574239-8ad4-434b-ac3d-26f9acc34f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.506199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea574239-8ad4-434b-ac3d-26f9acc34f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.507633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea574239-8ad4-434b-ac3d-26f9acc34f78 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.517265 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1282/2546] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:18.396874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:18.401196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:18.462414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a352d0-2de5-4ff9-8768-0839ac96af86 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:18.467313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:18.467928 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:18.468207 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:18.468480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] PATH_INFO: `/v3/users/fc2a61901021445da7ee7557648fc9e2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:18.469590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2a61901021445da7ee7557648fc9e2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:18.471546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:18.516498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2a61901021445da7ee7557648fc9e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:18.517167 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2a61901021445da7ee7557648fc9e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:18.517758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2a61901021445da7ee7557648fc9e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:18.530480 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2a61901021445da7ee7557648fc9e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:18.537362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2a61901021445da7ee7557648fc9e2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:18.549644 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1265/2547] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:18 2022] DELETE /identity/v3/users/fc2a61901021445da7ee7557648fc9e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:18.554268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:18.554752 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:18.554856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:18.573706 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:18.575505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:18.634941 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1283/2548] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:18.646123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:18.647576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:18.728472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a157e88-313e-4449-a091-d304969dacd1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:18.732769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:18.733360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:18.733637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:18.733937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:18.743086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:18.744541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:18.756158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1266/2549] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:19.023928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.025385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.042976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1202-6913-4bf9-8a8e-44773881a562 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.048424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.049063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.049394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.049703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] PATH_INFO: `/v3/projects/278dcf6eaeeb4aa090a88de57c945387` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.051010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278dcf6eaeeb4aa090a88de57c945387)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.052932 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.098642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:19.099919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278dcf6eaeeb4aa090a88de57c945387', 'request_id': 'req-7a3809b5-df62-4dc7-8012-0f2c35587175'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.107499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278dcf6eaeeb4aa090a88de57c945387', 'request_id': 'req-7a3809b5-df62-4dc7-8012-0f2c35587175'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.112968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278dcf6eaeeb4aa090a88de57c945387', 'request_id': 'req-7a3809b5-df62-4dc7-8012-0f2c35587175'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.125895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] The token cache is being invalidate because project 278dcf6eaeeb4aa090a88de57c945387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:19.126182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.126794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.128275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1284/2550] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:19 2022] DELETE /identity/v3/projects/278dcf6eaeeb4aa090a88de57c945387 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:19.132368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.139059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:19.142899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067256a-fd3a-483e-99eb-637e14a8cfd1 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.200409 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.201057 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.201348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.201611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] PATH_INFO: `/v3/users/f22f5e207ff544209d00918ec3f319ba` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.202759 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22f5e207ff544209d00918ec3f319ba)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.204688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.249266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22f5e207ff544209d00918ec3f319ba'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.249939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22f5e207ff544209d00918ec3f319ba'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.250570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22f5e207ff544209d00918ec3f319ba'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.262641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22f5e207ff544209d00918ec3f319ba'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.269985 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-17d66d47-a7f9-49d4-8e77-04feb96f3630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22f5e207ff544209d00918ec3f319ba'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.281815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1267/2551] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:19 2022] DELETE /identity/v3/users/f22f5e207ff544209d00918ec3f319ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:19.550930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.552357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.565708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3809b5-df62-4dc7-8012-0f2c35587175 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.628482 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.629116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.629395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.629670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] PATH_INFO: `/v3/projects/201e293938ae45b696df7cbb2011e7f5` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.630828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=201e293938ae45b696df7cbb2011e7f5)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.632742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.677980 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201e293938ae45b696df7cbb2011e7f5', 'request_id': 'req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.684368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201e293938ae45b696df7cbb2011e7f5', 'request_id': 'req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.690049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201e293938ae45b696df7cbb2011e7f5', 'request_id': 'req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.702808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] The token cache is being invalidate because project 201e293938ae45b696df7cbb2011e7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:19.703095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.703716 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8a3297d-9c63-4cb9-aae5-01eae4da4fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.705190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1285/2552] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:19 2022] DELETE /identity/v3/projects/201e293938ae45b696df7cbb2011e7f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:19.711032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.711541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.711698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.731361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:19.732560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.789736 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1268/2553] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:19.798411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.798705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.799044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.818970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:19.820159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.828582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1286/2554] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:19.832665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.842186 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ad263-9f24-4227-a085-5d56a9634f78 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.846635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.847223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.847501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.847779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.848420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:19.848719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.850345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.861730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1269/2555] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:19.866084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.875869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b16e1-3af1-4bda-8df9-2e10cf46eafb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.880552 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.881145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.881424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.881695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.882405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.884301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.911483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1287/2556] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:19.916049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.927111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535b19-516f-450f-97a8-cf7839c0bb79 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.934863 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:19.985073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.985668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.985986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.986266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.986902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.989008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.011357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1270/2557] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:20.015521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.025469 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2fc8-af4f-41a6-83c1-86b269110252 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.030137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.030726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.031005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.031273 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.031902 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.033607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.044219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1288/2558] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:20.048114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.058040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015e28a-9a80-445a-b36a-bc7ea675413e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.063153 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121e27-b8d7-4d9e-9f5b-2297235c0c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.063753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121e27-b8d7-4d9e-9f5b-2297235c0c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.064008 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121e27-b8d7-4d9e-9f5b-2297235c0c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.064276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121e27-b8d7-4d9e-9f5b-2297235c0c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.064903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d121e27-b8d7-4d9e-9f5b-2297235c0c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.066541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d121e27-b8d7-4d9e-9f5b-2297235c0c24 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.077834 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1271/2559] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:20.082882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.092651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327def23-6a17-4232-9308-d2f1e92e1670 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.097352 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.098034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.098320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.098597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] PATH_INFO: `/v3/projects/dcca174b4a5a4c0da9a9712bb9c57ee6/users/f6a38e2f21454694b0b007d0bac529d6/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.113194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcca174b4a5a4c0da9a9712bb9c57ee6, user_id=f6a38e2f21454694b0b007d0bac529d6, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.115867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.129322 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1289/2560] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:20 2022] PUT /identity/v3/projects/dcca174b4a5a4c0da9a9712bb9c57ee6/users/f6a38e2f21454694b0b007d0bac529d6/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:20.141314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.141599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.141896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.169211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] MFA Rules not processed for user `f6a38e2f21454694b0b007d0bac529d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.170472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.232608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1272/2561] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:20.236972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.241387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.301779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6d5fd-06ea-40f0-a376-04ef6e4475fb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.306454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.307052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.307333 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.307604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.308275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.310184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.335743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1290/2562] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:20.339743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.350619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6921481-9989-4bfb-8904-f688b3c6ce5f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.420058 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.420666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.420948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.421222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.421889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.423826 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.444934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1273/2563] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:20.448884 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.459730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91fff-7c46-4066-89ef-da505f6b23c9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.464345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.464988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.465253 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.465521 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.466185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.467785 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.478470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1291/2564] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:20.482846 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.493317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306aa85-be0b-4d9f-b3f4-32588a4c9b0d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.499307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.499957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.500234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.500507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] PATH_INFO: `/v3/projects/4dd9147beed54f44b7abbd416076fca7/users/4dc969cb992047859db2db4305516d7c/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.503648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.516790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd9147beed54f44b7abbd416076fca7, user_id=4dc969cb992047859db2db4305516d7c, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.519673 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.532198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1274/2565] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:20 2022] PUT /identity/v3/projects/4dd9147beed54f44b7abbd416076fca7/users/4dc969cb992047859db2db4305516d7c/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:20.536238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.546494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a370ab-3a38-4ad0-a3b8-236315451c0c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.600878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a6da7-709f-4c1c-95f5-13c94240bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.601484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6da7-709f-4c1c-95f5-13c94240bfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.601665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6da7-709f-4c1c-95f5-13c94240bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.601972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6da7-709f-4c1c-95f5-13c94240bfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.602600 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a6da7-709f-4c1c-95f5-13c94240bfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.604184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a6da7-709f-4c1c-95f5-13c94240bfaf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.614000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1292/2566] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:20.625616 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.635955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563538-b109-4db9-b041-77595f838e41 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.640620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.641259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.641534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.641806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] PATH_INFO: `/v3/projects/4dd9147beed54f44b7abbd416076fca7/users/4dc969cb992047859db2db4305516d7c/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.643752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd9147beed54f44b7abbd416076fca7, user_id=4dc969cb992047859db2db4305516d7c, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.646425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.656397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1275/2567] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:20 2022] PUT /identity/v3/projects/4dd9147beed54f44b7abbd416076fca7/users/4dc969cb992047859db2db4305516d7c/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:20.666711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.666994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.667267 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.697443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] MFA Rules not processed for user `4dc969cb992047859db2db4305516d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.698847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.759688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.765882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1293/2568] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:20.776799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.778606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.855653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a070b-ba1b-458b-b163-c148316d8787 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.859290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d0518-ed02-46d3-9838-ffb34f9dfce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.859887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d0518-ed02-46d3-9838-ffb34f9dfce6 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.860163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d0518-ed02-46d3-9838-ffb34f9dfce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.860432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d0518-ed02-46d3-9838-ffb34f9dfce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.914954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d0518-ed02-46d3-9838-ffb34f9dfce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.916629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d0518-ed02-46d3-9838-ffb34f9dfce6 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.925798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1276/2569] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:23.458302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:23.519590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1b20-678f-482b-899f-a9840f39bae0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:23.524083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:23.524709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:23.524991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:23.525263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] PATH_INFO: `/v3/users/f6a38e2f21454694b0b007d0bac529d6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:23.526401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a38e2f21454694b0b007d0bac529d6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:23.528374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:23.572558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a38e2f21454694b0b007d0bac529d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:23.579803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a38e2f21454694b0b007d0bac529d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:23.592089 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a38e2f21454694b0b007d0bac529d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:23.592745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a38e2f21454694b0b007d0bac529d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:23.599604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a38e2f21454694b0b007d0bac529d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:23.605795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1294/2570] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:23 2022] DELETE /identity/v3/users/f6a38e2f21454694b0b007d0bac529d6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:23.610257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:23.610737 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:23.610839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:23.630477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:23.632122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:23.695763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1277/2571] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:23.706149 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:23.707564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:23.765405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984e4f2-9675-4525-a3ea-10da7dfb2f6d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:23.769119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:23.769780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:23.770036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:23.770310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:23.779936 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:23.781369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:23.790898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1295/2572] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:24.061685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.063237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.075685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def00cd-b827-4aeb-a183-5d9c45ab9b60 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.080445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.081163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.081511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.081878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] PATH_INFO: `/v3/projects/dcca174b4a5a4c0da9a9712bb9c57ee6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.083066 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcca174b4a5a4c0da9a9712bb9c57ee6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.085248 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.087149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:24.133873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcca174b4a5a4c0da9a9712bb9c57ee6', 'request_id': 'req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.139934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcca174b4a5a4c0da9a9712bb9c57ee6', 'request_id': 'req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.145370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcca174b4a5a4c0da9a9712bb9c57ee6', 'request_id': 'req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.158108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] The token cache is being invalidate because project dcca174b4a5a4c0da9a9712bb9c57ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:24.158390 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.159023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.160495 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1278/2573] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:24 2022] DELETE /identity/v3/projects/dcca174b4a5a4c0da9a9712bb9c57ee6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:24.164534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.174989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e633fd-7237-4cb7-822f-164660a72bc4 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.190886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:24.231982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.232612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.232890 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.233164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] PATH_INFO: `/v3/users/4dc969cb992047859db2db4305516d7c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.234315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc969cb992047859db2db4305516d7c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.236284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.281599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc969cb992047859db2db4305516d7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.290603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc969cb992047859db2db4305516d7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.303575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc969cb992047859db2db4305516d7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.304271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc969cb992047859db2db4305516d7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.310999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d482765a-3f69-40c7-af3e-7ae893bde0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc969cb992047859db2db4305516d7c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.316766 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1296/2574] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:24 2022] DELETE /identity/v3/users/4dc969cb992047859db2db4305516d7c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:24.584622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.586114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.600594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3bc13-d61e-45ff-affc-1e9d99ebb919 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.658001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.658652 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.658892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.659165 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] PATH_INFO: `/v3/projects/4dd9147beed54f44b7abbd416076fca7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.660275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd9147beed54f44b7abbd416076fca7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.662242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.708111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd9147beed54f44b7abbd416076fca7', 'request_id': 'req-b9332e71-31bc-4fe0-a616-cffd61d7852b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.713955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd9147beed54f44b7abbd416076fca7', 'request_id': 'req-b9332e71-31bc-4fe0-a616-cffd61d7852b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.719942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd9147beed54f44b7abbd416076fca7', 'request_id': 'req-b9332e71-31bc-4fe0-a616-cffd61d7852b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.732723 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] The token cache is being invalidate because project 4dd9147beed54f44b7abbd416076fca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:24.733006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.733614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b9332e71-31bc-4fe0-a616-cffd61d7852b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.735138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1279/2575] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:24 2022] DELETE /identity/v3/projects/4dd9147beed54f44b7abbd416076fca7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:24.740863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.741360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.741457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.761055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:24.762305 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.821943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1297/2576] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:24.830685 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.830916 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.831189 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.850506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:24.851707 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.859820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1280/2577] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:24.863925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.874336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39995b-51e5-4dfa-b669-8d2b42ae6625 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.878962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.879559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.879839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.880115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.880758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:24.881063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.882688 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.894603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1298/2578] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:24.898868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.907962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481883-3765-4209-b96a-5aa788cb5fa1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.912557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.913145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.913421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.913694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.914364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.916512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.927635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:24.944896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1281/2579] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:24.949093 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.959459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66c301-1b7c-4ca4-85cf-e845a66120a5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.987095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:25.023393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.024006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.024290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.024566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.025202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.027165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.051046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1299/2580] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:25.056558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.068152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3b87-5199-4143-8ce8-4037d80c8aa2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.072771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.073513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.073932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.074318 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.075272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.077646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.088010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1282/2581] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:25.092330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.102177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158f11-51e7-45bb-9dd8-1695c57d3dec admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.107410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7697-5962-404c-83e5-e72cf4397675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.108009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7697-5962-404c-83e5-e72cf4397675 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.108288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7697-5962-404c-83e5-e72cf4397675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.108564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7697-5962-404c-83e5-e72cf4397675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.109210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7697-5962-404c-83e5-e72cf4397675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.110839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7697-5962-404c-83e5-e72cf4397675 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.121684 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1300/2582] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:25.125642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.135408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e2f68-a531-43a8-a4b4-d181d90e2b62 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.140941 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.141584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.141938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.142241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] PATH_INFO: `/v3/projects/2f84954bf4dc42d9a83e76be661bfccf/users/61875a2e721c4b769340fa54d8fcb501/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.157070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f84954bf4dc42d9a83e76be661bfccf, user_id=61875a2e721c4b769340fa54d8fcb501, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.159764 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.172968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1283/2583] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:25 2022] PUT /identity/v3/projects/2f84954bf4dc42d9a83e76be661bfccf/users/61875a2e721c4b769340fa54d8fcb501/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:25.184472 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae781-5b3d-46eb-a160-106407936289 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.184749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae781-5b3d-46eb-a160-106407936289 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.185018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae781-5b3d-46eb-a160-106407936289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.211857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-56eae781-5b3d-46eb-a160-106407936289 None None] MFA Rules not processed for user `61875a2e721c4b769340fa54d8fcb501`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:25.213044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-56eae781-5b3d-46eb-a160-106407936289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.276324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1301/2584] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:25.287492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.289217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.345679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fbd94-f23d-4524-a5b9-048553f5535b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.349252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069780a5-e0ce-49fc-8b87-fb31dada2958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.349874 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069780a5-e0ce-49fc-8b87-fb31dada2958 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.350160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069780a5-e0ce-49fc-8b87-fb31dada2958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.350435 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069780a5-e0ce-49fc-8b87-fb31dada2958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.359095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069780a5-e0ce-49fc-8b87-fb31dada2958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.360529 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069780a5-e0ce-49fc-8b87-fb31dada2958 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.369200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1284/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:25.394140 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eae781-5b3d-46eb-a160-106407936289 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.455393 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eae781-5b3d-46eb-a160-106407936289 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.460014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.460637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.460919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.461196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] PATH_INFO: `/v3/users/61875a2e721c4b769340fa54d8fcb501` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.462344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61875a2e721c4b769340fa54d8fcb501)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.464260 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.501535 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:25.511012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61875a2e721c4b769340fa54d8fcb501'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:25.518112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61875a2e721c4b769340fa54d8fcb501'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:25.530507 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61875a2e721c4b769340fa54d8fcb501'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:25.531162 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61875a2e721c4b769340fa54d8fcb501'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:25.537954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61875a2e721c4b769340fa54d8fcb501'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:25.544018 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1302/2586] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:25 2022] DELETE /identity/v3/users/61875a2e721c4b769340fa54d8fcb501 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:25.548459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.548741 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.549015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.568088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:25.569289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.626275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1285/2587] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:25.635657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.637629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.694029 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4ab2d-ebd2-4994-bdfc-91ceb208d493 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.697665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d45b4-367c-4731-86e1-b6f2e6ae4d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.698298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d45b4-367c-4731-86e1-b6f2e6ae4d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.698581 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d45b4-367c-4731-86e1-b6f2e6ae4d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.698859 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d45b4-367c-4731-86e1-b6f2e6ae4d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.707669 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d45b4-367c-4731-86e1-b6f2e6ae4d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.709099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d45b4-367c-4731-86e1-b6f2e6ae4d3c service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.718888 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1303/2588] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:25.985558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.987075 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.001610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec27c46-5709-49bf-b858-dfcc7e4c37d9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.007086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.008268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.008715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.008999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] PATH_INFO: `/v3/projects/2f84954bf4dc42d9a83e76be661bfccf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.010297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f84954bf4dc42d9a83e76be661bfccf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.012302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.059175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f84954bf4dc42d9a83e76be661bfccf', 'request_id': 'req-5ecdd21a-5729-4e44-af27-74247080fc72'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.065170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f84954bf4dc42d9a83e76be661bfccf', 'request_id': 'req-5ecdd21a-5729-4e44-af27-74247080fc72'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.066388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.072945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f84954bf4dc42d9a83e76be661bfccf', 'request_id': 'req-5ecdd21a-5729-4e44-af27-74247080fc72'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.085802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] The token cache is being invalidate because project 2f84954bf4dc42d9a83e76be661bfccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:26.086118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.086730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5ecdd21a-5729-4e44-af27-74247080fc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.088198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1286/2589] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:25 2022] DELETE /identity/v3/projects/2f84954bf4dc42d9a83e76be661bfccf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:26.093079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.093533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.093645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.114338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:26.115533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.174967 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1304/2590] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:26.182597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.182890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.183160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.203344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:26.204541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.212271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1287/2591] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:26.216879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.226355 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336be1ee-668c-4b1f-8d0e-d10fc67cbd90 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.230871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.231455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.231733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.232001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.232642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:26.232943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.234580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.245861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1305/2592] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:26.250727 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.259903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69ee35-5fca-4f7d-a013-b83d810aab78 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.265166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.265751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.266063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.266338 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.266969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.268861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.297111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1288/2593] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:26.300999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.313513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c72f2-1afa-4583-9b09-b664f181dad8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.354400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.370739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.371872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.372154 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.372427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.373049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.375016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.400781 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1306/2594] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:26.405600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.416139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa1b8-b71f-48ce-939a-40b5235f20c6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.421555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.422129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.422408 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.422678 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.423315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.425045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.437038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1289/2595] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:26.441138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.451036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d53e3-a7a6-4a7c-bfcc-c833bb2b073e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.455612 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9e02d-2e26-4b96-ab16-f3a47d9b44ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.456201 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9e02d-2e26-4b96-ab16-f3a47d9b44ec admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.456479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9e02d-2e26-4b96-ab16-f3a47d9b44ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.456747 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9e02d-2e26-4b96-ab16-f3a47d9b44ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.457724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9e02d-2e26-4b96-ab16-f3a47d9b44ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.459110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9e02d-2e26-4b96-ab16-f3a47d9b44ec admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.469877 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1307/2596] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:26.473981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.484362 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa62c-80ec-4334-acb1-cfa5d5fbbe21 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.488899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.489536 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.489816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.490123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] PATH_INFO: `/v3/projects/3a1798424f504236ae79f57d49383570/users/e0af7e90f71e40cfbc7f79d1407a9611/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.504754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1798424f504236ae79f57d49383570, user_id=e0af7e90f71e40cfbc7f79d1407a9611, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.507455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.520010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1290/2597] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:26 2022] PUT /identity/v3/projects/3a1798424f504236ae79f57d49383570/users/e0af7e90f71e40cfbc7f79d1407a9611/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:26.530713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.531041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.531364 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.559780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] MFA Rules not processed for user `e0af7e90f71e40cfbc7f79d1407a9611`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:26.560966 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.622115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1308/2598] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:26.632561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.634313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.690527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdd310-5d3f-4129-aead-30379ee1aca4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.694100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.694692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.694974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.695245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.703949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.705388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.714034 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1291/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:36.161356 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:36.162858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.268505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ca600-11a6-4fbc-b6b0-fb4c451e9a65 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:36.273638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:36.274340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.274621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.274889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.276642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.288135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:36.290007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:36.299882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1309/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:36.710086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=3,keystone:SELECT=57,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:42.953986 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:42.955516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:43.021161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e910be-3ba2-4213-90f3-32d7ee7b030a service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:43.024754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:43.025373 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:43.025630 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:43.025937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:43.028368 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:43.093201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:43.094669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:43.104128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1292/2601] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:45.981345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:45.983128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.001254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d987d-54d9-4226-8d98-0bdfceb6d1eb service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.006266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.006907 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.007192 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.007468 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] PATH_INFO: `/v3/users/a76438b57a2140cca853e0e71fb28f64` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.008633 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76438b57a2140cca853e0e71fb28f64)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.011312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.029270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.062409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76438b57a2140cca853e0e71fb28f64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.075026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76438b57a2140cca853e0e71fb28f64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.087022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76438b57a2140cca853e0e71fb28f64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.087652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76438b57a2140cca853e0e71fb28f64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.095494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76438b57a2140cca853e0e71fb28f64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.101375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1310/2602] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:45 2022] DELETE /identity/v3/users/a76438b57a2140cca853e0e71fb28f64 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:46.122413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.132120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ce35-549d-4908-87f6-84cd053d7e4e service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.197304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.198492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.198782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.199056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] PATH_INFO: `/v3/users/e0af7e90f71e40cfbc7f79d1407a9611` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.200375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0af7e90f71e40cfbc7f79d1407a9611)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.202752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.266412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0af7e90f71e40cfbc7f79d1407a9611'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.267067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0af7e90f71e40cfbc7f79d1407a9611'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.267674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0af7e90f71e40cfbc7f79d1407a9611'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.272470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.287950 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0af7e90f71e40cfbc7f79d1407a9611'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.298474 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-65f5d006-3cb3-4c1a-a27a-a9dc0b3daf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0af7e90f71e40cfbc7f79d1407a9611'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.306544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.308067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.331168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d50ec-e249-4e9f-b9bf-8c7d0450b05a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.341888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1293/2603] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:46 2022] DELETE /identity/v3/users/e0af7e90f71e40cfbc7f79d1407a9611 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:46.344361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.345215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.345444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eba88-b0a5-4cc6-86a5-4d5a2d66e47b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.345673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.345788 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eba88-b0a5-4cc6-86a5-4d5a2d66e47b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.346082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] PATH_INFO: `/v3/projects/eed416bd0f5f4e2e8453db6ff35f6ac5` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.346285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eba88-b0a5-4cc6-86a5-4d5a2d66e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.347430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed416bd0f5f4e2e8453db6ff35f6ac5)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.349744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.366239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ef7eba88-b0a5-4cc6-86a5-4d5a2d66e47b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:46.367455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ef7eba88-b0a5-4cc6-86a5-4d5a2d66e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.399928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'request_id': 'req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.406801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'request_id': 'req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.413383 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed416bd0f5f4e2e8453db6ff35f6ac5', 'request_id': 'req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.426773 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] The token cache is being invalidate because project eed416bd0f5f4e2e8453db6ff35f6ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:46.427065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.427675 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:46.428016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1294/2604] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:46.429194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1311/2605] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:46 2022] DELETE /identity/v3/projects/eed416bd0f5f4e2e8453db6ff35f6ac5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:46.433989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050c91e-aa8b-49a1-a718-ffe9cfd9fe32 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.434280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050c91e-aa8b-49a1-a718-ffe9cfd9fe32 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.434559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050c91e-aa8b-49a1-a718-ffe9cfd9fe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.438238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.439596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.454626 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a050c91e-aa8b-49a1-a718-ffe9cfd9fe32 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:46.455809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a050c91e-aa8b-49a1-a718-ffe9cfd9fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.500425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d23d2-f1a4-45fc-a216-3ac7c0f2d094 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.504381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.504989 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.505266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.505566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.507330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.517232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1295/2606] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:46.524999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.525283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.525561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.540500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.546100 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:46.547391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.555906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1296/2607] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:46.560537 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.569528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ca85-5af0-4080-a7c9-8d072b1c8261 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.574265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.574847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.575156 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.575287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.575445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.576067 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:46.576372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.576718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.578205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.586750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1312/2608] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:46.590794 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1297/2609] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:46.595164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.604570 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17758478-9f68-42e6-a379-c20634bfc468 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.611727 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.612338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.612618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.612893 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.613539 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.615479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.644689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1313/2610] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:46 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:46.648982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.660132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f994-5288-4a7b-8109-f82aae193c48 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.709706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.721315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.721966 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.722293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.722812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.723457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.725389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.755293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1298/2611] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:46 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:46.759551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.771120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf0807-bf07-478c-a773-791d16c799b6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.775923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.777164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.777438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.777707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.778385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.779997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.792178 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1314/2612] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:46.795926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.806083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b268af-155b-49c8-ab7d-8975034e6b9f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.811311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.811905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.812181 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.812449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.813088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.814711 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.825539 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1299/2613] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:46.829836 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.840196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd879-6b35-402e-a61b-f32ac96b73e7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.844812 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de165a52-88a1-4b2d-86df-c325674a1cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.845538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de165a52-88a1-4b2d-86df-c325674a1cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.845942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de165a52-88a1-4b2d-86df-c325674a1cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.846188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de165a52-88a1-4b2d-86df-c325674a1cea admin admin] PATH_INFO: `/v3/projects/174af9dd587a482fb2ef70d297588e4e/users/5f750f3d811143bc88269d2ff0b4c1ee/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.861653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de165a52-88a1-4b2d-86df-c325674a1cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=174af9dd587a482fb2ef70d297588e4e, user_id=5f750f3d811143bc88269d2ff0b4c1ee, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.866208 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de165a52-88a1-4b2d-86df-c325674a1cea admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.867700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.870470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.884795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1315/2614] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:46 2022] PUT /identity/v3/projects/174af9dd587a482fb2ef70d297588e4e/users/5f750f3d811143bc88269d2ff0b4c1ee/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:46.886656 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f628-70e9-43ac-a083-008b9decb9c5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.896704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.896994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.897275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.927130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] MFA Rules not processed for user `5f750f3d811143bc88269d2ff0b4c1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:46.928454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.960920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.961594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.961912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.962202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] PATH_INFO: `/v3/projects/3a1798424f504236ae79f57d49383570` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.963667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1798424f504236ae79f57d49383570)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.965653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.993202 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1316/2615] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:47.005461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.006958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.015825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1798424f504236ae79f57d49383570', 'request_id': 'req-5fb09386-51ee-4bfd-b250-9c97c98f25fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.022703 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1798424f504236ae79f57d49383570', 'request_id': 'req-5fb09386-51ee-4bfd-b250-9c97c98f25fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.028597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1798424f504236ae79f57d49383570', 'request_id': 'req-5fb09386-51ee-4bfd-b250-9c97c98f25fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.042581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] The token cache is being invalidate because project 3a1798424f504236ae79f57d49383570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:47.042872 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.043533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fb09386-51ee-4bfd-b250-9c97c98f25fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.045033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1300/2616] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:46 2022] DELETE /identity/v3/projects/3a1798424f504236ae79f57d49383570 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:47.049661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd75e-c755-44f9-95b7-1bdb7119e8f5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.049963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd75e-c755-44f9-95b7-1bdb7119e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.050249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd75e-c755-44f9-95b7-1bdb7119e8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.070821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-90acd75e-c755-44f9-95b7-1bdb7119e8f5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:47.071519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:47.072103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-90acd75e-c755-44f9-95b7-1bdb7119e8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.114421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84332d-04df-435f-8c7a-aabbdad609ff None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.125076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:47.135187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1301/2617] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:47.142452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.142750 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.143007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.162210 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:47.163364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.171982 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1302/2618] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:47.176095 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.181450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.182097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.182473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.182755 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.184605 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.184857 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830d4b-f447-465d-9e13-30b2ac427394 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.189352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.189963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.190237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.190505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.191137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:47.191436 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.193010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.204640 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1303/2619] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:47.209022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.218514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716322c1-5af4-4503-9b8e-80d26cb48305 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.223208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.223838 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.224118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.224393 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.225010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.226939 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.244165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.245901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.255269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1317/2620] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:47.255502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1304/2621] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:47 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:47.259919 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.270445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4139da4-9454-4679-85ea-00765bdd8a7f service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.327928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.328538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.328815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.329085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.329708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.331652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.348538 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:47.355430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1318/2622] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:47 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:47.359818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.371122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637fd0e-3936-4430-91cc-fd7978f330d2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.375821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.376710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.376710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.376947 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.377581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.379211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.389345 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1305/2623] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:47.393348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.404150 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10c08f-d13a-4779-aca8-0930c31977f4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.409108 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4cda-8451-46dc-ae33-4a07499a2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.409772 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4cda-8451-46dc-ae33-4a07499a2006 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.410078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4cda-8451-46dc-ae33-4a07499a2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.410346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4cda-8451-46dc-ae33-4a07499a2006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.410979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda4cda-8451-46dc-ae33-4a07499a2006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.412611 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda4cda-8451-46dc-ae33-4a07499a2006 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.423123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1319/2624] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:47.427946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.439879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5900fce-0ef2-47a2-b48e-88f23b7143ee admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.444744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.445397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.445681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.445993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] PATH_INFO: `/v3/projects/00ff2d1fed3649eaac8582a5b5e67890/users/2eafb2d5beb641c68179cda0f9c6b8ab/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.462621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ff2d1fed3649eaac8582a5b5e67890, user_id=2eafb2d5beb641c68179cda0f9c6b8ab, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.466042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.480490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1306/2625] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:47 2022] PUT /identity/v3/projects/00ff2d1fed3649eaac8582a5b5e67890/users/2eafb2d5beb641c68179cda0f9c6b8ab/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:47.491194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.491477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.491750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.522678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] MFA Rules not processed for user `2eafb2d5beb641c68179cda0f9c6b8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:47.524203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.606185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1320/2626] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:47.618342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.621200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.681144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af050-0049-45e7-95da-eda001437f35 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.685386 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.686121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.686405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.686681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.694863 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.696411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.705499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1307/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:57.599620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=38 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:57.682217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:57.682337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.701365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:57.747750 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6180-ff5e-4af2-bd2a-f69b173fb36c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:57.752330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:57.752956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.753234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.753505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] PATH_INFO: `/v3/users/5f750f3d811143bc88269d2ff0b4c1ee` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.754650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f750f3d811143bc88269d2ff0b4c1ee)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:57.756580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:57.803511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f750f3d811143bc88269d2ff0b4c1ee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.812606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f750f3d811143bc88269d2ff0b4c1ee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.819013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:57.825548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f750f3d811143bc88269d2ff0b4c1ee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.826306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f750f3d811143bc88269d2ff0b4c1ee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.830281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37320-13f0-4019-84da-992f3ac73cb7 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:57.833320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7042f32b-41e8-480a-b65a-d0049866b9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f750f3d811143bc88269d2ff0b4c1ee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.834921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:57.835560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.835839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.836113 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] PATH_INFO: `/v3/users/2eafb2d5beb641c68179cda0f9c6b8ab` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.837274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eafb2d5beb641c68179cda0f9c6b8ab)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:57.839242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:57.839694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1321/2628] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:57 2022] DELETE /identity/v3/users/5f750f3d811143bc88269d2ff0b4c1ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:57.844033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.844308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.844580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.869792 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:57.870787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.896468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eafb2d5beb641c68179cda0f9c6b8ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.897110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eafb2d5beb641c68179cda0f9c6b8ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.897709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eafb2d5beb641c68179cda0f9c6b8ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.909465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eafb2d5beb641c68179cda0f9c6b8ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.917783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6219edd0-83b6-4221-908a-044d2f163d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eafb2d5beb641c68179cda0f9c6b8ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:57.929747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1308/2629] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:57 2022] DELETE /identity/v3/users/2eafb2d5beb641c68179cda0f9c6b8ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:57.934612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.934975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.935314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.935742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1322/2630] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:57.945590 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:57.947115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.955339 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:57.957094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.968959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:58.008935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0978-4023-43ec-aec4-27c9a37ab3a3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.018961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1309/2631] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:58.029043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.030467 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.058803 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.059409 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.059683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.059952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.069107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.070494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.080687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1323/2632] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:58.088899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7104-f818-4ac4-9c16-95923d3f6b95 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.092568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.093172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.093448 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.093719 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.102772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.104331 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.114365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1310/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:58.528088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.529760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.550963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18abaaf-90a2-432a-b9e4-09b3725d84e2 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.552365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.553782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.555732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.556645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.558353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.558745 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] PATH_INFO: `/v3/projects/174af9dd587a482fb2ef70d297588e4e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.560671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=174af9dd587a482fb2ef70d297588e4e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.562867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.574648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b8165-d33d-4481-ba2d-6fc990aa3933 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.591146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.591802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.592094 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.592361 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] PATH_INFO: `/v3/projects/00ff2d1fed3649eaac8582a5b5e67890` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.594120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ff2d1fed3649eaac8582a5b5e67890)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.596249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.610637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:58.617964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174af9dd587a482fb2ef70d297588e4e', 'request_id': 'req-ffcec707-5a77-40d8-a7a5-49365eadd3d4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.625461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174af9dd587a482fb2ef70d297588e4e', 'request_id': 'req-ffcec707-5a77-40d8-a7a5-49365eadd3d4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.631166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174af9dd587a482fb2ef70d297588e4e', 'request_id': 'req-ffcec707-5a77-40d8-a7a5-49365eadd3d4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.644499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] The token cache is being invalidate because project 174af9dd587a482fb2ef70d297588e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:58.644865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.645492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ffcec707-5a77-40d8-a7a5-49365eadd3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.647170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1324/2634] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:58 2022] DELETE /identity/v3/projects/174af9dd587a482fb2ef70d297588e4e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:58.652083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.652374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.652653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.655708 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ff2d1fed3649eaac8582a5b5e67890', 'request_id': 'req-f531f3d0-67cc-410e-8f3b-e6368c00116d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.663115 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ff2d1fed3649eaac8582a5b5e67890', 'request_id': 'req-f531f3d0-67cc-410e-8f3b-e6368c00116d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.670936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ff2d1fed3649eaac8582a5b5e67890', 'request_id': 'req-f531f3d0-67cc-410e-8f3b-e6368c00116d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.672705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:58.673949 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.684247 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] The token cache is being invalidate because project 00ff2d1fed3649eaac8582a5b5e67890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:58.684531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.685148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f531f3d0-67cc-410e-8f3b-e6368c00116d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.686730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1311/2635] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:58 2022] DELETE /identity/v3/projects/00ff2d1fed3649eaac8582a5b5e67890 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:58.746838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1325/2636] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:58.755128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.755721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.755721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.778734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:58.779963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.788107 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1312/2637] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:58.792928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.797961 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:58.805017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885429-0bff-4c8c-bfcf-c6e5100a61db None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.811796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.812427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.812708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.812982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.813645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:58.813993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.815622 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.829061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1326/2638] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:58.833470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.843396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d4334-4d93-4553-a952-8a09c373d9ed None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.848581 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.849902 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.850206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.850484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.851169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.853111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.882733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1313/2639] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:58 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:58.887709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.898495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f849-c869-4006-b091-770a8d29b34e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.960718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.961459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.961824 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.962228 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.962959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.965005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.985897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1327/2640] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:58 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:58.990038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.000755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc068-2fdd-45d3-857b-ae882942e515 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.005283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.005895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.006180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.006452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.007089 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.008706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.018983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1314/2641] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:59.022770 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.032426 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc485d-9e5a-408e-b4e7-eb81c1bfe17d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.036920 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd5088-061f-45fa-a57b-c27850cb59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.037499 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd5088-061f-45fa-a57b-c27850cb59d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.037774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd5088-061f-45fa-a57b-c27850cb59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.038075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd5088-061f-45fa-a57b-c27850cb59d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.038708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd5088-061f-45fa-a57b-c27850cb59d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.040537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd5088-061f-45fa-a57b-c27850cb59d2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.051193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1328/2642] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:59.054994 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.065298 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8690-09d6-4546-aff2-bc557082a41b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.069803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.070485 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.070758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.071029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] PATH_INFO: `/v3/projects/a95b945b1bc24214802fe27d959ae9c2/users/66c334c0b30941398664e5aaea08d5a8/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.085396 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95b945b1bc24214802fe27d959ae9c2, user_id=66c334c0b30941398664e5aaea08d5a8, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.088081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.100592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1315/2643] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:59 2022] PUT /identity/v3/projects/a95b945b1bc24214802fe27d959ae9c2/users/66c334c0b30941398664e5aaea08d5a8/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:59.111263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.111543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.111813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.139191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] MFA Rules not processed for user `66c334c0b30941398664e5aaea08d5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:59.140392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.203075 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1329/2644] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:59.207614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.267367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c12c4-815a-40e1-a01b-6fcc875ab2d0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.272011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.272605 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.272883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.273157 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.273786 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.276223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.303129 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1316/2645] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:59.307308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.317744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eab33e-ff82-4277-b153-f6b0909100b0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.367242 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:59.374110 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.374895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.375335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.375808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.376437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.378390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.397982 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1330/2646] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:59.402451 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.412559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9703c06-657b-4a4b-a0bf-367612cc27f2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.417972 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.418559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.418837 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.419108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.419763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.421326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.431567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1317/2647] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:59.435662 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.445257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fef35-41b0-458b-8c90-c3c7c775dfc8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.449742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.450395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.450668 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.450935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] PATH_INFO: `/v3/projects/aae6e0648d924203bd82f81507037d8f/users/16a83cfa58d444908ec0efc4c05e195a/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.466518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae6e0648d924203bd82f81507037d8f, user_id=16a83cfa58d444908ec0efc4c05e195a, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.469298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.482484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1331/2648] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:59 2022] PUT /identity/v3/projects/aae6e0648d924203bd82f81507037d8f/users/16a83cfa58d444908ec0efc4c05e195a/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:59.486745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.499460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab8cee-2063-4e1d-8090-8caef0e1f12c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.504088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:59.569403 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead41176-218e-422b-a53d-d76afa64e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.570038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead41176-218e-422b-a53d-d76afa64e80c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.570320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead41176-218e-422b-a53d-d76afa64e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.570599 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead41176-218e-422b-a53d-d76afa64e80c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.571792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead41176-218e-422b-a53d-d76afa64e80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.574038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead41176-218e-422b-a53d-d76afa64e80c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.587300 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1318/2649] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:59.591679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.605033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141537e6-61b3-4d99-84cf-dcb55b3a9998 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.609701 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.610411 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.610685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.610953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] PATH_INFO: `/v3/projects/aae6e0648d924203bd82f81507037d8f/users/16a83cfa58d444908ec0efc4c05e195a/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.612863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae6e0648d924203bd82f81507037d8f, user_id=16a83cfa58d444908ec0efc4c05e195a, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.615550 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.626629 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1332/2650] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:59 2022] PUT /identity/v3/projects/aae6e0648d924203bd82f81507037d8f/users/16a83cfa58d444908ec0efc4c05e195a/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:59.638969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.639337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.639679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.668276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] MFA Rules not processed for user `16a83cfa58d444908ec0efc4c05e195a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:59.669558 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.737091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1319/2651] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:59.749692 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.751423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.807759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4ec8-5967-4c71-895f-f26b3590cf5a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.811362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.811950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.812225 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.812493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.821209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.822683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.832043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1333/2652] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:00.140781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.149822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d25c7-cf40-45cb-80b7-aca06261aaf5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.154400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a83cfa58d444908ec0efc4c05e195a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aae6e0648d924203bd82f81507037d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.154996 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.155277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.155557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.156229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:00.156533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.158234 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.169695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1320/2653] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:00.174024 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.183608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d0757-c9a9-4bee-bda0-757604732893 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.188384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a83cfa58d444908ec0efc4c05e195a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aae6e0648d924203bd82f81507037d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.188928 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.189207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.189485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.190157 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.192060 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.218493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1334/2654] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:00 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:00.222492 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.232687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeda49-22f6-459a-a788-1f2941ae08d5 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.286712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a83cfa58d444908ec0efc4c05e195a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aae6e0648d924203bd82f81507037d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.287330 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.287591 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.287865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.288534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:00.288839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.290758 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.302419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1321/2655] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:00.339288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.349271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb144164-4097-4b8b-919e-218999d2d9d3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.353789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a83cfa58d444908ec0efc4c05e195a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aae6e0648d924203bd82f81507037d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.354440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.354722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.354994 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] PATH_INFO: `/v3/projects/efe06f54a34a4ff7965627e9db360ec7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.356114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorizing `identity:delete_project(project_id=efe06f54a34a4ff7965627e9db360ec7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.358102 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.404268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe06f54a34a4ff7965627e9db360ec7', 'request_id': 'req-eaf0b51b-8366-451a-aa99-f07556de3a59'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.410970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe06f54a34a4ff7965627e9db360ec7', 'request_id': 'req-eaf0b51b-8366-451a-aa99-f07556de3a59'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.417281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe06f54a34a4ff7965627e9db360ec7', 'request_id': 'req-eaf0b51b-8366-451a-aa99-f07556de3a59'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.429270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] The token cache is being invalidate because project efe06f54a34a4ff7965627e9db360ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:00.429556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.430234 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-eaf0b51b-8366-451a-aa99-f07556de3a59 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.432404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1335/2656] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:00 2022] DELETE /identity/v3/projects/efe06f54a34a4ff7965627e9db360ec7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:00.620358 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.622305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.635888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:00.686322 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4eed4-df62-4bb9-8aca-08375d1f1bc3 tempest-VolumeQuotaClassesTest-582105439 tempest-VolumeQuotaClassesTest-582105439-project-admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.740735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.741353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.741625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.741922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] PATH_INFO: `/v3/users/66c334c0b30941398664e5aaea08d5a8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.743042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c334c0b30941398664e5aaea08d5a8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.745517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.800293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c334c0b30941398664e5aaea08d5a8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.800955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c334c0b30941398664e5aaea08d5a8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.801559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c334c0b30941398664e5aaea08d5a8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.814073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c334c0b30941398664e5aaea08d5a8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.821870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c334c0b30941398664e5aaea08d5a8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:00.834808 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1322/2657] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:00 2022] DELETE /identity/v3/users/66c334c0b30941398664e5aaea08d5a8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:00.839608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079354d6-2c68-4b80-a452-827652012869 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.840082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079354d6-2c68-4b80-a452-827652012869 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.840180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079354d6-2c68-4b80-a452-827652012869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.859527 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-079354d6-2c68-4b80-a452-827652012869 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:00.860777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-079354d6-2c68-4b80-a452-827652012869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.870065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:00.924813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1336/2658] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:00.934458 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.935860 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.978051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:00.994877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9731c-2a66-45cc-8c1a-ce19d3a31fa8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.998502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.999097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.999374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.999645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:01.008512 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:01.009962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:01.019151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1323/2659] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:01.283184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079354d6-2c68-4b80-a452-827652012869 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:01.284618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-079354d6-2c68-4b80-a452-827652012869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:01.301654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079354d6-2c68-4b80-a452-827652012869 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:01.306176 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:01.307412 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:01.307780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:01.307938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] PATH_INFO: `/v3/projects/a95b945b1bc24214802fe27d959ae9c2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:01.309127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95b945b1bc24214802fe27d959ae9c2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:01.311120 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:01.357672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95b945b1bc24214802fe27d959ae9c2', 'request_id': 'req-212800f6-0b5c-4f38-afc2-898dd54986c5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.363908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95b945b1bc24214802fe27d959ae9c2', 'request_id': 'req-212800f6-0b5c-4f38-afc2-898dd54986c5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.370275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95b945b1bc24214802fe27d959ae9c2', 'request_id': 'req-212800f6-0b5c-4f38-afc2-898dd54986c5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.382641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] The token cache is being invalidate because project a95b945b1bc24214802fe27d959ae9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:01.382926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.383531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.385048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1337/2660] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:01 2022] DELETE /identity/v3/projects/a95b945b1bc24214802fe27d959ae9c2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:01.389365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:01.400653 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65134c4-8be5-4eb0-94c0-9b0afb9fc48b service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:01.456035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:01.456651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:01.456931 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:01.457206 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] PATH_INFO: `/v3/users/16a83cfa58d444908ec0efc4c05e195a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:01.458342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a83cfa58d444908ec0efc4c05e195a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:01.460245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:01.504679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a83cfa58d444908ec0efc4c05e195a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.505272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a83cfa58d444908ec0efc4c05e195a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.505886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a83cfa58d444908ec0efc4c05e195a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.518743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a83cfa58d444908ec0efc4c05e195a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.525770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6a749435-d3ae-4220-8ec0-7a05d13074ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a83cfa58d444908ec0efc4c05e195a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.537790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1324/2661] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:01 2022] DELETE /identity/v3/users/16a83cfa58d444908ec0efc4c05e195a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:01.809705 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:01.811224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:01.825078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212800f6-0b5c-4f38-afc2-898dd54986c5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:01.884749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:01.885880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:01.886153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:01.886424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] PATH_INFO: `/v3/projects/aae6e0648d924203bd82f81507037d8f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:01.887560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae6e0648d924203bd82f81507037d8f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:01.889450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:01.932818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:01.940904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae6e0648d924203bd82f81507037d8f', 'request_id': 'req-473cdc01-06d9-4621-980d-8c16f33a3458'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.947549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae6e0648d924203bd82f81507037d8f', 'request_id': 'req-473cdc01-06d9-4621-980d-8c16f33a3458'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.953227 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae6e0648d924203bd82f81507037d8f', 'request_id': 'req-473cdc01-06d9-4621-980d-8c16f33a3458'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.965652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] The token cache is being invalidate because project aae6e0648d924203bd82f81507037d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:01.965970 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.966683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-473cdc01-06d9-4621-980d-8c16f33a3458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:01.968184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1338/2662] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:01 2022] DELETE /identity/v3/projects/aae6e0648d924203bd82f81507037d8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:01.973111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:01.973503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:01.973786 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:01.993998 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:01.995249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.047116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:02.055688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1325/2663] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:02.065568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.065866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.066168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.086320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:02.087525 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.095930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1339/2664] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:02.100007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.109715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf280d-2d71-4a63-a0c0-8277eef4255d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.114347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.114964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.115240 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.115507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.116147 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:02.116446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.118048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.129336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1326/2665] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:02.133329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.143211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3aeef-9592-4630-a1ea-5544cdee6ae9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.147816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.148404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.148683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.148954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.149588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.151598 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.178494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1340/2666] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:02.183116 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.192917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf9d45-07c6-42c8-a6e0-cc0f2fb10987 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.247642 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.248229 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.248502 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.248768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.249388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.251324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.272177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1327/2667] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:02.276676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.286924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4942cd-4c0b-4dc4-886e-02f2dbe6c536 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.292470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.293006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.293281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.293586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.294257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.295854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.305756 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1341/2668] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:02.309777 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.319494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fec6b8-25ca-4353-a164-0fe4e6cc7190 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.324024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e5783-2c3f-4c67-8e7e-0f99a17536a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.324606 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5783-2c3f-4c67-8e7e-0f99a17536a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.324882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5783-2c3f-4c67-8e7e-0f99a17536a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.325151 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5783-2c3f-4c67-8e7e-0f99a17536a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.325781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e5783-2c3f-4c67-8e7e-0f99a17536a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.327399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e5783-2c3f-4c67-8e7e-0f99a17536a0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.338525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1328/2669] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:02.342369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.352068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530d970-deb0-4ea0-85ba-61e1b9ced9d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.356625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.357257 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.357533 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.357811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] PATH_INFO: `/v3/projects/8e1207bf6a65482591d208e036500c57/users/fadee3faaaae4f3fbf4e9deb420c3867/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.374086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1207bf6a65482591d208e036500c57, user_id=fadee3faaaae4f3fbf4e9deb420c3867, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.376732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.390122 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1342/2670] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:02 2022] PUT /identity/v3/projects/8e1207bf6a65482591d208e036500c57/users/fadee3faaaae4f3fbf4e9deb420c3867/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:02.400823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.401316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.401424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.429525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] MFA Rules not processed for user `fadee3faaaae4f3fbf4e9deb420c3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:02.430932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.493376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1329/2671] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:02.498374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.560163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52268f87-b175-4417-aae8-8a81b8ff8776 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.564774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.565371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.565652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.565958 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.566583 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.568473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.595243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1343/2672] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:02.599405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.610333 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8dcb6-60e7-4a48-94d0-e8dd798de20d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.660237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:02.668144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.668747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.669023 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.669294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.669944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.671849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.692130 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1330/2673] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:02.696132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.706873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87568-64fb-4b40-9b57-e93fb61b89e1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.711474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.712066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.712351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.712628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.713866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.715467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.725758 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1344/2674] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:02.729744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.739981 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297c236-ac81-4f9b-b3a4-c415bb03735a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.744660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.745304 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.745586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.745885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] PATH_INFO: `/v3/projects/d7a5761cdbe243f4b81c877797ba700b/users/9c0a3d9b88eb46ad81f1692d83287b62/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.761104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a5761cdbe243f4b81c877797ba700b, user_id=9c0a3d9b88eb46ad81f1692d83287b62, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.763849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.777411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1331/2675] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:02 2022] PUT /identity/v3/projects/d7a5761cdbe243f4b81c877797ba700b/users/9c0a3d9b88eb46ad81f1692d83287b62/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:02.781531 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.791875 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308f05-5a45-48bc-9aa5-315483b4b9ea admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.824460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:02.849658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd995df5-6e0c-49e3-9b40-3a0d0ddb06dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.850297 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd995df5-6e0c-49e3-9b40-3a0d0ddb06dd admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.850734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd995df5-6e0c-49e3-9b40-3a0d0ddb06dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.851216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd995df5-6e0c-49e3-9b40-3a0d0ddb06dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.852112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd995df5-6e0c-49e3-9b40-3a0d0ddb06dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.853711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd995df5-6e0c-49e3-9b40-3a0d0ddb06dd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.863991 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1345/2676] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:02.867960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.878317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45774-8624-42b1-a90e-befafaf3bc4e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.885302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.886209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.886493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.886772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] PATH_INFO: `/v3/projects/d7a5761cdbe243f4b81c877797ba700b/users/9c0a3d9b88eb46ad81f1692d83287b62/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.888803 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a5761cdbe243f4b81c877797ba700b, user_id=9c0a3d9b88eb46ad81f1692d83287b62, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.891520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.902683 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1332/2677] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:02 2022] PUT /identity/v3/projects/d7a5761cdbe243f4b81c877797ba700b/users/9c0a3d9b88eb46ad81f1692d83287b62/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:02.914757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.915323 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.915439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.943778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] MFA Rules not processed for user `9c0a3d9b88eb46ad81f1692d83287b62`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:02.944977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:03.014543 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1346/2678] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:03.028772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.030559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:03.094747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8c1fa-63f6-4402-bbdd-b43588be2c58 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.098578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.099271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.099618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.099961 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.109264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.110816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.121086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1333/2679] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:03.215390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.225057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b48da-fba3-4666-b75d-103c315d59f8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.228749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ae5a8-1881-41d6-a3f9-393776ec9b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.229381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ae5a8-1881-41d6-a3f9-393776ec9b16 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.229659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ae5a8-1881-41d6-a3f9-393776ec9b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.229965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ae5a8-1881-41d6-a3f9-393776ec9b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.295689 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ae5a8-1881-41d6-a3f9-393776ec9b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.297139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ae5a8-1881-41d6-a3f9-393776ec9b16 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.306145 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1347/2680] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:08.047738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:08.116121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ed64e-f0ea-4e21-9f5c-18814347456b service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:08.121283 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:08.121935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:08.122215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:08.122487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] PATH_INFO: `/v3/users/fadee3faaaae4f3fbf4e9deb420c3867` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:08.123592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadee3faaaae4f3fbf4e9deb420c3867)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:08.125518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:08.179288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadee3faaaae4f3fbf4e9deb420c3867'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.179934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadee3faaaae4f3fbf4e9deb420c3867'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.180631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadee3faaaae4f3fbf4e9deb420c3867'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.185739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:08.197038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadee3faaaae4f3fbf4e9deb420c3867'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.203763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadee3faaaae4f3fbf4e9deb420c3867'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.215852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1334/2681] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:08 2022] DELETE /identity/v3/users/fadee3faaaae4f3fbf4e9deb420c3867 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:08.220284 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:08.220739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:08.220854 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:08.240038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:08.241169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:08.290678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:08.300252 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1348/2682] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:08.309776 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:08.311205 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:08.366805 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96d2f-61da-4ba2-93a5-452827678307 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:08.370477 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:08.371070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:08.371346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:08.371619 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:08.380400 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:08.381812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:08.391120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1335/2683] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:08.661987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:08.664555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:08.682530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea66b6-8a27-4914-8131-bbeb099378f0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:08.687797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:08.688439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:08.688724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:08.689000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] PATH_INFO: `/v3/projects/8e1207bf6a65482591d208e036500c57` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:08.690549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1207bf6a65482591d208e036500c57)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:08.693012 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:08.739270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1207bf6a65482591d208e036500c57', 'request_id': 'req-03270ef2-c02a-4815-bfaf-ea52999c0719'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.746052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1207bf6a65482591d208e036500c57', 'request_id': 'req-03270ef2-c02a-4815-bfaf-ea52999c0719'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.751558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1207bf6a65482591d208e036500c57', 'request_id': 'req-03270ef2-c02a-4815-bfaf-ea52999c0719'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.763746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] The token cache is being invalidate because project 8e1207bf6a65482591d208e036500c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:08.764033 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.764663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.766203 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1349/2684] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:08 2022] DELETE /identity/v3/projects/8e1207bf6a65482591d208e036500c57 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:08.770273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:08.780412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061289-81eb-4c2e-beec-0382f7593d77 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:08.840896 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:08.841546 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:08.841882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:08.842148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] PATH_INFO: `/v3/users/9c0a3d9b88eb46ad81f1692d83287b62` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:08.843260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0a3d9b88eb46ad81f1692d83287b62)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:08.845214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:08.890743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0a3d9b88eb46ad81f1692d83287b62'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.891381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0a3d9b88eb46ad81f1692d83287b62'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.891971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0a3d9b88eb46ad81f1692d83287b62'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.903646 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0a3d9b88eb46ad81f1692d83287b62'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.910420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8777b050-25bb-469a-acee-bb213f7e4dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0a3d9b88eb46ad81f1692d83287b62'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:08.912376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:08.925310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1336/2685] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:08 2022] DELETE /identity/v3/users/9c0a3d9b88eb46ad81f1692d83287b62 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:09.547603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:09.549094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:09.562492 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270ef2-c02a-4815-bfaf-ea52999c0719 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:09.630977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:09.631528 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:09.631801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:09.632069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] PATH_INFO: `/v3/projects/d7a5761cdbe243f4b81c877797ba700b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:09.633158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a5761cdbe243f4b81c877797ba700b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:09.635628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:09.680063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a5761cdbe243f4b81c877797ba700b', 'request_id': 'req-22fcade3-afcd-42af-9307-9f95b1062cd1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:09.686278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a5761cdbe243f4b81c877797ba700b', 'request_id': 'req-22fcade3-afcd-42af-9307-9f95b1062cd1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:09.691780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a5761cdbe243f4b81c877797ba700b', 'request_id': 'req-22fcade3-afcd-42af-9307-9f95b1062cd1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:09.703733 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] The token cache is being invalidate because project d7a5761cdbe243f4b81c877797ba700b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:09.704048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:09.704648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-22fcade3-afcd-42af-9307-9f95b1062cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:09.706175 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1350/2686] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:09 2022] DELETE /identity/v3/projects/d7a5761cdbe243f4b81c877797ba700b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:09.712141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:09.712713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:09.712827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:09.732709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:09.733952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:09.790353 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1337/2687] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:09.798872 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:09.799159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:09.799434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:09.820977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:09.822858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:09.831266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1351/2688] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:09.835118 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:09.850174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16489281-221f-4b00-a6b8-45a7768c8897 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:09.861060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:09.861933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:09.862212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:09.862489 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:09.863183 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:09.863553 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:09.865132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:09.886618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1338/2689] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:09.890960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:09.898661 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:09.906650 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61aeae-3888-45d9-b603-c3fea373f2ad None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:09.913687 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:09.914619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:09.915034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:09.915321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:09.915988 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:09.917931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:09.952722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1352/2690] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:09 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:09.956850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:09.968753 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51660-75d4-422c-89b7-494a82f97643 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.039337 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.039949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.040217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.040514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.041145 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.043141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.068411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1339/2691] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:09 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:10.073169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.084046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d32c16-8400-4c21-8d7c-33ff46bba7a7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.090058 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.090697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.090983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.091254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.091954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.093591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.106637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1353/2692] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:10.110414 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.121388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8928a-0326-4a3c-90d2-022b07f33c97 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.127577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c400-2e6e-48fb-8601-fd5f8c1495ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.128273 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c400-2e6e-48fb-8601-fd5f8c1495ab admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.128618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c400-2e6e-48fb-8601-fd5f8c1495ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.128959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c400-2e6e-48fb-8601-fd5f8c1495ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.129669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6c400-2e6e-48fb-8601-fd5f8c1495ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.131367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6c400-2e6e-48fb-8601-fd5f8c1495ab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.143382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1340/2693] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:10.147396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.158219 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982239d-027a-4f53-bd2d-c73f267afc9e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.165138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.166715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.167051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.167453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] PATH_INFO: `/v3/projects/919fddea76794b59b9f1c702acc752b0/users/5c33809d31cd4b9cb29174897d654ee0/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.183434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] RBAC: Authorizing `identity:create_grant(project_id=919fddea76794b59b9f1c702acc752b0, user_id=5c33809d31cd4b9cb29174897d654ee0, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.186481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.203036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1354/2694] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:10 2022] PUT /identity/v3/projects/919fddea76794b59b9f1c702acc752b0/users/5c33809d31cd4b9cb29174897d654ee0/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:10.214967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.215256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.215517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.245712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] MFA Rules not processed for user `5c33809d31cd4b9cb29174897d654ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:10.246969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:10.316468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:10.339945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1341/2695] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:10.344744 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.441424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324316d2-d48c-4d5c-bff8-863925a9734b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.447315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.447993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.448282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.448557 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.449194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.451560 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.491086 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1355/2696] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:10 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:10.495111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.508478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736156cd-9b4e-42bc-9458-6a20662ce3e9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.597592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.598491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.598943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.599484 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.600123 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.602091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.627849 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1342/2697] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:10 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:10.632006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.643067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd56725-247d-484d-a2bd-e7553b5588f8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.647837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.648448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.648779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.649002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.649776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.652094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.662873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1356/2698] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:10.667993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.678093 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183654f7-dbd3-48ce-a3f1-ae4316ec44b3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.683999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.684782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.685354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.685354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] PATH_INFO: `/v3/projects/0452939283254621aeaa7ca5206872d6/users/6e2964080ede403aade2589bcf0437da/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.700861 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0452939283254621aeaa7ca5206872d6, user_id=6e2964080ede403aade2589bcf0437da, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.703580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.726677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1343/2699] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:10 2022] PUT /identity/v3/projects/0452939283254621aeaa7ca5206872d6/users/6e2964080ede403aade2589bcf0437da/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:10.732309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.744243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e59be-d804-4077-bb6b-9f27ccf5b045 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.852658 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce281fb4-2ed0-4d68-b074-1eebc65a909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.857882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce281fb4-2ed0-4d68-b074-1eebc65a909f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.857882 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce281fb4-2ed0-4d68-b074-1eebc65a909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.858177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce281fb4-2ed0-4d68-b074-1eebc65a909f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.859300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce281fb4-2ed0-4d68-b074-1eebc65a909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.861166 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce281fb4-2ed0-4d68-b074-1eebc65a909f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.890895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1357/2700] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:10.891923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:10.907141 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d913cd-05f9-4075-a0c5-9e71bb30bbfd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:10.912620 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:10.913596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.913975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.914594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] PATH_INFO: `/v3/projects/0452939283254621aeaa7ca5206872d6/users/6e2964080ede403aade2589bcf0437da/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.916785 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0452939283254621aeaa7ca5206872d6, user_id=6e2964080ede403aade2589bcf0437da, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:10.919700 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:10.949933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1344/2701] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:10 2022] PUT /identity/v3/projects/0452939283254621aeaa7ca5206872d6/users/6e2964080ede403aade2589bcf0437da/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:10.958231 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.958516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.958798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.000085 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] MFA Rules not processed for user `6e2964080ede403aade2589bcf0437da`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:11.001155 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.016408 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:11.075452 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:11.080459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.132663 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1358/2702] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:11.146431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:11.148413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.169691 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01028ee8-da2f-48ac-aebc-5f3451c99e34 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:11.178623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:11.179303 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.179582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.179913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.183848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.196172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:11.197709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:11.208037 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1345/2703] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:11.236677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390c5e-7d22-4f42-bfaa-5972ba723b28 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:11.241292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:11.241944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.242371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.242693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.260270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:11.262057 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:11.273241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1359/2704] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:11.330540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:11.342364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876931b-6a9f-4e99-a575-2ff2b84b27fa service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:11.346689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:11.347398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.347772 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.348138 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.350055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.365077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:11.374067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4d0a-2237-43eb-a08e-2c0da509f9a9 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:11.378351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1d906-388e-47c0-82c8-1886de156c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:11.378953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d906-388e-47c0-82c8-1886de156c05 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.379232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d906-388e-47c0-82c8-1886de156c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.379502 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d906-388e-47c0-82c8-1886de156c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.399131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:11.435059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:11.436417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:11.448316 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1346/2705] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:11.449914 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1d906-388e-47c0-82c8-1886de156c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:11.452169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1d906-388e-47c0-82c8-1886de156c05 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:11.462978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1360/2706] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:11.824262 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:11.894576 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087f18-660a-421c-ba7b-df9601968af5 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:11.899114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:11.899749 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.900577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.900850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] PATH_INFO: `/v3/users/5c33809d31cd4b9cb29174897d654ee0` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.901993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c33809d31cd4b9cb29174897d654ee0)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:11.903920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:11.952045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c33809d31cd4b9cb29174897d654ee0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:11.952618 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c33809d31cd4b9cb29174897d654ee0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:11.953222 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c33809d31cd4b9cb29174897d654ee0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:11.965102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c33809d31cd4b9cb29174897d654ee0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:11.973674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c33809d31cd4b9cb29174897d654ee0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:11.987172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1347/2707] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:11 2022] DELETE /identity/v3/users/5c33809d31cd4b9cb29174897d654ee0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:11.991587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.992040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.992147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:12.011723 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:12.012944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:12.059128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:12.079123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1361/2708] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:12.090072 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:12.095336 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:12.157378 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:12.167610 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed84ed5-1cc1-4454-974d-ec4733383d1a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:12.172825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:12.173813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:12.174325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:12.174604 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:12.190913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:12.192342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:12.205935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1348/2709] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:12.627130 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:12.628679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:12.641371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a877-7139-4cd9-8ccc-d3e7cf553ce3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:12.646040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:12.646632 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:12.646915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:12.647195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] PATH_INFO: `/v3/projects/919fddea76794b59b9f1c702acc752b0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:12.648321 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] RBAC: Authorizing `identity:delete_project(project_id=919fddea76794b59b9f1c702acc752b0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:12.651049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:12.698443 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919fddea76794b59b9f1c702acc752b0', 'request_id': 'req-33abb116-2b22-4969-bb97-fcac0c4718af'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.704530 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919fddea76794b59b9f1c702acc752b0', 'request_id': 'req-33abb116-2b22-4969-bb97-fcac0c4718af'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.709835 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919fddea76794b59b9f1c702acc752b0', 'request_id': 'req-33abb116-2b22-4969-bb97-fcac0c4718af'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.722534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] The token cache is being invalidate because project 919fddea76794b59b9f1c702acc752b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:12.722818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.723451 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.724909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1362/2710] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:12 2022] DELETE /identity/v3/projects/919fddea76794b59b9f1c702acc752b0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:12.729534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:12.739200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b3f0-83ec-4b1d-af6f-973d81d7d9a6 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:12.805955 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:12.806647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:12.807693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:12.807975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] PATH_INFO: `/v3/users/6e2964080ede403aade2589bcf0437da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:12.809341 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2964080ede403aade2589bcf0437da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:12.811631 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:12.882215 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2964080ede403aade2589bcf0437da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.883020 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2964080ede403aade2589bcf0437da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.883735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2964080ede403aade2589bcf0437da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.899821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2964080ede403aade2589bcf0437da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.908839 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-942c2a14-c688-4d1e-9668-6384def4fd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2964080ede403aade2589bcf0437da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:12.926445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1349/2711] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:12 2022] DELETE /identity/v3/users/6e2964080ede403aade2589bcf0437da => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:13.400350 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:13.401811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:13.416173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb116-2b22-4969-bb97-fcac0c4718af admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:13.479726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:13.480369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:13.480651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:13.480926 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] PATH_INFO: `/v3/projects/0452939283254621aeaa7ca5206872d6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:13.482081 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0452939283254621aeaa7ca5206872d6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:13.484016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:13.539951 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0452939283254621aeaa7ca5206872d6', 'request_id': 'req-a63d1d66-b360-4fd4-bc32-ad31602994ab'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:13.550485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0452939283254621aeaa7ca5206872d6', 'request_id': 'req-a63d1d66-b360-4fd4-bc32-ad31602994ab'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:13.557188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0452939283254621aeaa7ca5206872d6', 'request_id': 'req-a63d1d66-b360-4fd4-bc32-ad31602994ab'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:13.569191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:13.574863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] The token cache is being invalidate because project 0452939283254621aeaa7ca5206872d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:13.575423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:13.579578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a63d1d66-b360-4fd4-bc32-ad31602994ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:13.585300 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1363/2712] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:13 2022] DELETE /identity/v3/projects/0452939283254621aeaa7ca5206872d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:13.587675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:13.588370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:13.588491 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:13.611875 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:13.613086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:13.696730 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1350/2713] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:13.701121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:13.701410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:13.701685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:13.723702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:13.724916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:13.736634 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1364/2714] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:13.737481 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:13.747967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f36ff-a91a-4b08-abcd-925f00e31f18 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:13.752847 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:13.753450 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:13.753729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:13.754032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:13.754698 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:13.754977 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:13.756589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:13.760426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:13.777021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1351/2715] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:13.777826 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:13.789243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f85a3-56a5-4aa8-8822-f3c266142ae2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:13.795193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:13.795927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:13.796209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:13.796485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:13.797125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:13.799424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:13.840345 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1365/2716] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:13.846601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:13.874399 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855befac-0171-431b-a76a-5522cd35a93d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.066888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.067516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.067725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.067997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.068629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.070568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.092394 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1352/2717] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:13 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:14.096575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:14.106883 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc73c6d-eaa9-4e2f-baad-9a583d33f328 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.111301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.111892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.112169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.112444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.113080 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.114710 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.124387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1366/2718] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:14.128190 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:14.138389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd097699-dea4-47b6-824b-e4da3bc4bb56 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.142853 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232993d2-6edb-4f9c-9220-14dc05bc0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.143425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232993d2-6edb-4f9c-9220-14dc05bc0df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.143696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232993d2-6edb-4f9c-9220-14dc05bc0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.143959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232993d2-6edb-4f9c-9220-14dc05bc0df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.144582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232993d2-6edb-4f9c-9220-14dc05bc0df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.146223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232993d2-6edb-4f9c-9220-14dc05bc0df9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.156177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1353/2719] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:14.160020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:14.170008 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979720c8-f113-403c-9320-d30d2a1381c3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.174503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.175128 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.175406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.175695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] PATH_INFO: `/v3/projects/1eb392b7120f46d0b66df9e9065b1172/users/12d684a904a245a9ba1998a9d9d036ec/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.189722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb392b7120f46d0b66df9e9065b1172, user_id=12d684a904a245a9ba1998a9d9d036ec, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.192455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.206067 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1367/2720] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:14 2022] PUT /identity/v3/projects/1eb392b7120f46d0b66df9e9065b1172/users/12d684a904a245a9ba1998a9d9d036ec/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:14.217596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.217909 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.218184 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.245697 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] MFA Rules not processed for user `12d684a904a245a9ba1998a9d9d036ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:14.246956 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:14.314603 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1354/2721] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:14.326306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:14.328002 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:14.383963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a84a0-c72e-43b0-a177-a95eb482e5b5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.388372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba7c3c-666c-4721-9cf1-f23bc8fab5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.389111 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba7c3c-666c-4721-9cf1-f23bc8fab5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.389523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba7c3c-666c-4721-9cf1-f23bc8fab5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.389804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba7c3c-666c-4721-9cf1-f23bc8fab5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.398243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba7c3c-666c-4721-9cf1-f23bc8fab5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.399915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba7c3c-666c-4721-9cf1-f23bc8fab5e7 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.408866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1368/2722] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:14.431687 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:14.495054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b0ba7-af37-4a8c-893d-56ca123af95b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.502293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.503128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.503417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.503690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] PATH_INFO: `/v3/users/12d684a904a245a9ba1998a9d9d036ec` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.505060 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d684a904a245a9ba1998a9d9d036ec)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.507486 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.513953 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:14.560323 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d684a904a245a9ba1998a9d9d036ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:14.561018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d684a904a245a9ba1998a9d9d036ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:14.561658 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d684a904a245a9ba1998a9d9d036ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:14.573597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d684a904a245a9ba1998a9d9d036ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:14.580975 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d684a904a245a9ba1998a9d9d036ec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:14.594937 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1355/2723] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:14 2022] DELETE /identity/v3/users/12d684a904a245a9ba1998a9d9d036ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:14.599509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.599790 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.600061 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.619473 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:14.620659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:14.678014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1369/2724] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:14.687674 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:14.689102 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:14.748121 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047596-8f29-4fe3-950c-b61c0bb0b4f1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:14.752046 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70780fc-53f5-4774-a4d3-bdcab9ac33ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:14.752696 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70780fc-53f5-4774-a4d3-bdcab9ac33ab service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.752919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70780fc-53f5-4774-a4d3-bdcab9ac33ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.753191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70780fc-53f5-4774-a4d3-bdcab9ac33ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.762922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70780fc-53f5-4774-a4d3-bdcab9ac33ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:14.764344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70780fc-53f5-4774-a4d3-bdcab9ac33ab service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:14.773932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1356/2725] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:15.079647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.081095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:15.095444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a3f1a-3791-4316-88ef-05c5a970aec2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.100604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.101290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.101534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.101786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] PATH_INFO: `/v3/projects/1eb392b7120f46d0b66df9e9065b1172` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.103043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb392b7120f46d0b66df9e9065b1172)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.104954 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.141871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:15.158160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb392b7120f46d0b66df9e9065b1172', 'request_id': 'req-95efe191-41bd-490c-a987-db2d7317b079'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:15.164678 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb392b7120f46d0b66df9e9065b1172', 'request_id': 'req-95efe191-41bd-490c-a987-db2d7317b079'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:15.170216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb392b7120f46d0b66df9e9065b1172', 'request_id': 'req-95efe191-41bd-490c-a987-db2d7317b079'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:15.184670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] The token cache is being invalidate because project 1eb392b7120f46d0b66df9e9065b1172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:15.185082 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:15.185726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95efe191-41bd-490c-a987-db2d7317b079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:15.187401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1370/2726] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:15 2022] DELETE /identity/v3/projects/1eb392b7120f46d0b66df9e9065b1172 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:15.192320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.192815 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.192921 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.213202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:15.214454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:15.278325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1357/2727] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:15.286232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.286593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.286871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.307553 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:15.308751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:15.316903 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1371/2728] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:15.320912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.330380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5de2f7-3704-4ff1-bf17-15f1fc908a9d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.334822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.335417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.335692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.335962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.336614 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:15.336893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.339001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.350418 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1358/2729] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:15.354751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.363833 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc02c88-4655-4610-95ff-c7a4da0e3c76 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.369436 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.370084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.370365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.370760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.371401 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.373309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.401205 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1372/2730] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:15.405282 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.416079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606daef-54ae-4b5d-ba56-6e9578abd2fd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.424635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:15.474625 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.475216 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.475497 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.475775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.476392 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.478829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.499770 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1359/2731] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:15.503927 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.515335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973746-4d7b-4540-86ef-ba2ef525434a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.520182 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.520775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.521054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.521328 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.522023 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.523620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.533559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1373/2732] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:15.537513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.548174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18d5b3-0ee6-46c8-88db-81af8f1179f8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.552781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64178be2-cd65-49a3-8fcd-2b74188903f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.553364 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178be2-cd65-49a3-8fcd-2b74188903f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.553645 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178be2-cd65-49a3-8fcd-2b74188903f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.553944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178be2-cd65-49a3-8fcd-2b74188903f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.554580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64178be2-cd65-49a3-8fcd-2b74188903f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.556792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64178be2-cd65-49a3-8fcd-2b74188903f0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.566509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1360/2733] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:15.570410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.580255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd292e4-72f5-463b-895e-f92c3d145dc9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.584819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.585460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.585739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.586042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] PATH_INFO: `/v3/projects/94bd4416d2f4414dac2345bc005d9e18/users/21e7f24a27a5489f9cfc09535c29ba6f/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.601282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bd4416d2f4414dac2345bc005d9e18, user_id=21e7f24a27a5489f9cfc09535c29ba6f, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.604474 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.616566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1374/2734] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:15 2022] PUT /identity/v3/projects/94bd4416d2f4414dac2345bc005d9e18/users/21e7f24a27a5489f9cfc09535c29ba6f/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:15.627629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.628172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.628679 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.657671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] MFA Rules not processed for user `21e7f24a27a5489f9cfc09535c29ba6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:15.658914 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:15.720354 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1361/2735] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:15.724791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.785641 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c54497-6519-4743-a068-7bd99e445510 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.791047 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.791638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.791915 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.792183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.792809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.794743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.820368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1375/2736] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:15.824561 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.835296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553393-81f5-47b1-8cea-7919f8d4fb11 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.891669 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.892370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.892639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.892903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.893531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.895461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.917131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1362/2737] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:15.921211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.931454 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e39be-071d-4db9-9474-1ecf7ce538e7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.936143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.936736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.937011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.937279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.938017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.939594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.949814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1376/2738] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:15.953449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.963466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d663-dd29-49ca-bf83-0745775a052c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.968047 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c963bf-f59e-49e5-a0ba-36785b7cf741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.968621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c963bf-f59e-49e5-a0ba-36785b7cf741 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.968895 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c963bf-f59e-49e5-a0ba-36785b7cf741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.969161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c963bf-f59e-49e5-a0ba-36785b7cf741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.969787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c963bf-f59e-49e5-a0ba-36785b7cf741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.971385 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c963bf-f59e-49e5-a0ba-36785b7cf741 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.976412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:15.982406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1363/2739] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:15.986274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.996105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bfef8-dd7e-43f4-a740-14d43b735eb5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.000679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.001320 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.001604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.001910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] PATH_INFO: `/v3/projects/535b0ed7bfe44d94931cc5dd656344f1/users/bc0765a3266944ae9ae5dd2076577b27/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.016699 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535b0ed7bfe44d94931cc5dd656344f1, user_id=bc0765a3266944ae9ae5dd2076577b27, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.019458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.032593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1377/2740] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:15 2022] PUT /identity/v3/projects/535b0ed7bfe44d94931cc5dd656344f1/users/bc0765a3266944ae9ae5dd2076577b27/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:16.099475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.099756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.100031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.128174 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] MFA Rules not processed for user `bc0765a3266944ae9ae5dd2076577b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:16.129382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.193706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1364/2741] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:16.198775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.207414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:16.263735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebd21d-ddda-4ddd-9172-69018652c830 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.268584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.269190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.269471 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.269742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.270406 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.272309 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.299437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1378/2742] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:16 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:16.303475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.314601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163a43-b212-4c89-bf65-bf9d7e1cef7f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.369473 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.370016 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.370293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.370563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.371191 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.373105 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.393580 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1365/2743] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:16 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:16.397601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.408000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b3c96-dcfe-4640-a411-53bf4c55b9f1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.412789 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.413302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.413584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.414199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.414897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.416950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.427505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1379/2744] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:16.432261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.441903 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415469e-946c-4043-8a3a-bd9821a8a496 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.446963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.447621 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.447894 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.448160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] PATH_INFO: `/v3/projects/69186604d8c04e968a7a360cc7f43d7c/users/161439ae3fba46b5aadbc7a41357214a/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.463111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69186604d8c04e968a7a360cc7f43d7c, user_id=161439ae3fba46b5aadbc7a41357214a, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.465757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.479965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1366/2745] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:16 2022] PUT /identity/v3/projects/69186604d8c04e968a7a360cc7f43d7c/users/161439ae3fba46b5aadbc7a41357214a/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:16.484481 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.494738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8dfd-8f0e-419c-873c-0b4070310a05 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.556582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e6bff-1e66-4bd0-9016-7462fda646a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.557200 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6bff-1e66-4bd0-9016-7462fda646a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.557477 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6bff-1e66-4bd0-9016-7462fda646a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.557748 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6bff-1e66-4bd0-9016-7462fda646a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.558445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e6bff-1e66-4bd0-9016-7462fda646a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.560070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e6bff-1e66-4bd0-9016-7462fda646a0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.570043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1380/2746] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:16.574382 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.584374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b7466-a43f-442b-9b98-0dda9a445ff9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.589366 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.590029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.590306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.590578 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] PATH_INFO: `/v3/projects/69186604d8c04e968a7a360cc7f43d7c/users/161439ae3fba46b5aadbc7a41357214a/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.592449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69186604d8c04e968a7a360cc7f43d7c, user_id=161439ae3fba46b5aadbc7a41357214a, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.595119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.605415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1367/2747] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:16 2022] PUT /identity/v3/projects/69186604d8c04e968a7a360cc7f43d7c/users/161439ae3fba46b5aadbc7a41357214a/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:16.615358 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.615647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.615922 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.643421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] MFA Rules not processed for user `161439ae3fba46b5aadbc7a41357214a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:16.644582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.710460 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1381/2748] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:16.722239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.723906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.768862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:16.781740 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f04606-8eb0-4780-8af3-7bcdcf3a7ab6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.785326 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.785944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.786226 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.786494 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.843144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.844579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.854374 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1368/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:17.145062 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:17.152514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:17.160546 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0d65-c26e-4680-8b70-2b054a93007e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:17.165610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:17.166399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:17.166771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:17.167046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:17.171244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:17.233134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:17.234623 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:17.244319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1382/2750] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:18.369223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:18.370664 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:18.382263 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7218d-7dc5-4005-91fb-3ae0dcc0de73 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:18.386426 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce825-536a-4c58-87eb-c9503800e91d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:18.386657 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce825-536a-4c58-87eb-c9503800e91d service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:18.386933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce825-536a-4c58-87eb-c9503800e91d service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:18.387203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce825-536a-4c58-87eb-c9503800e91d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:18.451051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce825-536a-4c58-87eb-c9503800e91d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:18.452702 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce825-536a-4c58-87eb-c9503800e91d service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:18.464144 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1369/2751] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:20.532359 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:20.541918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33659db-f97b-46f9-973c-976e4672e242 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:20.545685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183232-ec37-4d50-add3-367fe41ace2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:20.546340 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183232-ec37-4d50-add3-367fe41ace2e service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:20.546619 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183232-ec37-4d50-add3-367fe41ace2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:20.546901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183232-ec37-4d50-add3-367fe41ace2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:20.555965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183232-ec37-4d50-add3-367fe41ace2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:20.557391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183232-ec37-4d50-add3-367fe41ace2e service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:20.567564 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1383/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:24.226068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:24.226560 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:24.226675 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:24.245712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] MFA Rules not processed for user `988168279e8e495a985e209a35764f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:24.246944 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:24.305204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1370/2753] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:25.254732 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732b18-48d8-4008-8e9a-454cf2ae558f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.255579 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732b18-48d8-4008-8e9a-454cf2ae558f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.256026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732b18-48d8-4008-8e9a-454cf2ae558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.278187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cb732b18-48d8-4008-8e9a-454cf2ae558f None None] MFA Rules not processed for user `5d8054341c0e46778e3b3db0b3dd1164`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:25.279464 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cb732b18-48d8-4008-8e9a-454cf2ae558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:25.292416 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1384/2754] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:26.601198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:26.656294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:26.681790 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2573ee-131a-4ee8-9db9-df817537471c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:26.687878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:26.688878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:26.689224 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:26.689598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] PATH_INFO: `/v3/users/21e7f24a27a5489f9cfc09535c29ba6f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:26.690992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e7f24a27a5489f9cfc09535c29ba6f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:26.693014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:26.741883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e7f24a27a5489f9cfc09535c29ba6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:26.742534 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e7f24a27a5489f9cfc09535c29ba6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:26.743188 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e7f24a27a5489f9cfc09535c29ba6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:26.754590 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e7f24a27a5489f9cfc09535c29ba6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:26.762852 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e7f24a27a5489f9cfc09535c29ba6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:26.776000 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1371/2755] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:26 2022] DELETE /identity/v3/users/21e7f24a27a5489f9cfc09535c29ba6f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:26.780339 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:26.780841 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:26.781442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:26.803822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:26.805048 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:26.873618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1385/2756] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:26.883886 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:26.885235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:26.943851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0358-b8be-47ce-9516-6174d18587bc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:26.947757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:26.948350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:26.948623 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:26.948891 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:26.957782 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:26.959281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:26.968488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1372/2757] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:27.360015 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:27.361427 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:27.375580 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6dab-af03-4607-bcc3-8dddea996b81 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:27.380963 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:27.381603 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:27.381904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:27.382177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] PATH_INFO: `/v3/projects/94bd4416d2f4414dac2345bc005d9e18` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:27.384247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bd4416d2f4414dac2345bc005d9e18)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:27.386218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:27.433798 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bd4416d2f4414dac2345bc005d9e18', 'request_id': 'req-5cc38e66-df98-4c44-be98-dc8190b0b5cb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.439817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bd4416d2f4414dac2345bc005d9e18', 'request_id': 'req-5cc38e66-df98-4c44-be98-dc8190b0b5cb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.445287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bd4416d2f4414dac2345bc005d9e18', 'request_id': 'req-5cc38e66-df98-4c44-be98-dc8190b0b5cb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.458537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] The token cache is being invalidate because project 94bd4416d2f4414dac2345bc005d9e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:27.458801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.459431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.460898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1386/2758] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:27 2022] DELETE /identity/v3/projects/94bd4416d2f4414dac2345bc005d9e18 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:27.465012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:27.474531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bbf5-a72b-4485-9509-25de9948cb14 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:27.538137 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:27.539021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:27.539297 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:27.539592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] PATH_INFO: `/v3/users/bc0765a3266944ae9ae5dd2076577b27` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:27.541207 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0765a3266944ae9ae5dd2076577b27)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:27.543160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:27.545359 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:27.593479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0765a3266944ae9ae5dd2076577b27'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.594150 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0765a3266944ae9ae5dd2076577b27'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.594763 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0765a3266944ae9ae5dd2076577b27'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.607375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0765a3266944ae9ae5dd2076577b27'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.616134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0765a3266944ae9ae5dd2076577b27'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:27.632035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1373/2759] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:27 2022] DELETE /identity/v3/users/bc0765a3266944ae9ae5dd2076577b27 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:28.230891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:28.233760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:28.244389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:28.248730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38e66-df98-4c44-be98-dc8190b0b5cb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:28.400362 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:28.401351 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:28.401807 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:28.402281 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] PATH_INFO: `/v3/projects/535b0ed7bfe44d94931cc5dd656344f1` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:28.403765 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535b0ed7bfe44d94931cc5dd656344f1)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:28.406126 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:28.486984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535b0ed7bfe44d94931cc5dd656344f1', 'request_id': 'req-27873a75-5167-436c-bbf1-8e07892d3ae4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.495820 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535b0ed7bfe44d94931cc5dd656344f1', 'request_id': 'req-27873a75-5167-436c-bbf1-8e07892d3ae4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.504041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535b0ed7bfe44d94931cc5dd656344f1', 'request_id': 'req-27873a75-5167-436c-bbf1-8e07892d3ae4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.526195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] The token cache is being invalidate because project 535b0ed7bfe44d94931cc5dd656344f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:28.527121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.528185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.533897 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1387/2760] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:28 2022] DELETE /identity/v3/projects/535b0ed7bfe44d94931cc5dd656344f1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:28.534660 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:28.536168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:28.564887 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a919-6383-426d-9b8f-a79ed5f3d039 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:28.658973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:28.659597 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:28.662038 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:28.662682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] PATH_INFO: `/v3/users/161439ae3fba46b5aadbc7a41357214a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:28.664325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=161439ae3fba46b5aadbc7a41357214a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:28.667501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:28.754733 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161439ae3fba46b5aadbc7a41357214a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.755930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161439ae3fba46b5aadbc7a41357214a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.756535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161439ae3fba46b5aadbc7a41357214a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.772239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161439ae3fba46b5aadbc7a41357214a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.787325 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d931e937-f650-4805-9800-ab056e2facb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161439ae3fba46b5aadbc7a41357214a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:28.817892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:28.826065 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1374/2761] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:28 2022] DELETE /identity/v3/users/161439ae3fba46b5aadbc7a41357214a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:29.395724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.397172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:29.415177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27873a75-5167-436c-bbf1-8e07892d3ae4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.503485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.504083 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.504572 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.504839 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] PATH_INFO: `/v3/projects/69186604d8c04e968a7a360cc7f43d7c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.506232 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69186604d8c04e968a7a360cc7f43d7c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.508394 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:29.550865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:29.564983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69186604d8c04e968a7a360cc7f43d7c', 'request_id': 'req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:29.572038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69186604d8c04e968a7a360cc7f43d7c', 'request_id': 'req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:29.579369 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69186604d8c04e968a7a360cc7f43d7c', 'request_id': 'req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:29.595779 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] The token cache is being invalidate because project 69186604d8c04e968a7a360cc7f43d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:29.596069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:29.596720 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-decce4b3-fa0f-46a9-ab8e-4096c7b6e3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:29.598384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1388/2762] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:29 2022] DELETE /identity/v3/projects/69186604d8c04e968a7a360cc7f43d7c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:29.603974 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.604251 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.604692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.625629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:29.627148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:29.700412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1375/2763] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:29.709388 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.709690 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.709969 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.732500 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:29.733838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:29.742245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1389/2764] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:29.746510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.756007 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dd11f-6471-4406-8ada-1e7eff1e41b5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.761550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.762198 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.762479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.762751 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.763410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:29.763712 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.765315 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:29.779918 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1376/2765] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:29.784702 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.798551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b1bf1-225a-4775-abee-d8154b6cbb93 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.806455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.807070 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.807341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.807607 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.808673 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.810194 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:29.841891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1390/2766] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:29.845344 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.856175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a25d3-fe27-4317-91b3-1364d55f709b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.935584 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.936307 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.936589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.936862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.937499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.944513 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:29.974376 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1377/2767] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:29.978683 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.989134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98cacf-58d2-408b-a616-f8b29c814e61 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.994326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.994931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.995197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.995470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.996109 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.997704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.007944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1391/2768] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:30.012101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.022692 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b2e0-4ab2-4b46-a657-03a0715472de admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.028128 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b7354-8856-498e-8a55-0a03a1571a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.028725 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b7354-8856-498e-8a55-0a03a1571a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.029027 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b7354-8856-498e-8a55-0a03a1571a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.029319 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b7354-8856-498e-8a55-0a03a1571a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.029967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b7354-8856-498e-8a55-0a03a1571a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.031556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b7354-8856-498e-8a55-0a03a1571a27 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.046933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1378/2769] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:30.048072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.059290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08830-dd8c-4653-9c5f-feb9b9bd9d7c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.066007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.066740 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.067019 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.067290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] PATH_INFO: `/v3/projects/a1a6554fb0f242c18cd475cad255d5c5/users/928feb4832ed4d42a765bdd393cbefa6/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.082816 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a6554fb0f242c18cd475cad255d5c5, user_id=928feb4832ed4d42a765bdd393cbefa6, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.086904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.100142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1392/2770] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:30 2022] PUT /identity/v3/projects/a1a6554fb0f242c18cd475cad255d5c5/users/928feb4832ed4d42a765bdd393cbefa6/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:30.105754 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2234b-423f-43f6-bca2-4b28c54af287 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.106106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2234b-423f-43f6-bca2-4b28c54af287 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.106423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2234b-423f-43f6-bca2-4b28c54af287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.130518 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-60e2234b-423f-43f6-bca2-4b28c54af287 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:30.131731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-60e2234b-423f-43f6-bca2-4b28c54af287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:30.188419 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1379/2771] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:30.198159 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.199869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:30.256245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b63d-0373-4b79-a390-c7be8e6a5d4f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.259921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.260519 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.260799 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.261069 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.269759 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.271209 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.280860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1393/2772] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:31.154787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482dd51-f6c8-42ce-9797-56f0c4542f44 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:31.155272 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482dd51-f6c8-42ce-9797-56f0c4542f44 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:31.155470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482dd51-f6c8-42ce-9797-56f0c4542f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:31.184470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:31.212987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3482dd51-f6c8-42ce-9797-56f0c4542f44 None None] MFA Rules not processed for user `928feb4832ed4d42a765bdd393cbefa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:31.215352 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3482dd51-f6c8-42ce-9797-56f0c4542f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:31.308078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1380/2773] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:31.315488 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:31.316939 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:31.393651 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149662-7db7-458e-907a-8482d6df474a service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:31.397375 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:31.398107 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:31.398392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:31.398667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:31.407402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:31.408830 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:31.418052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1394/2774] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:32.798929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21656dc2-990f-4cfe-8d7c-e65b84c28249 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.799460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21656dc2-990f-4cfe-8d7c-e65b84c28249 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.799460 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21656dc2-990f-4cfe-8d7c-e65b84c28249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.818850 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-21656dc2-990f-4cfe-8d7c-e65b84c28249 None None] MFA Rules not processed for user `928feb4832ed4d42a765bdd393cbefa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:32.820056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-21656dc2-990f-4cfe-8d7c-e65b84c28249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:32.826868 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1381/2775] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:41.413985 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.813488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=32 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.982143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.991455 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba8af-beca-4238-b024-4159489f770c service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.995595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.996184 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.996463 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.996735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.998476 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.062306 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:46.063796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfd9ea-69ba-43e7-aeab-d73392cebb31 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:46.074514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1395/2776] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:52.956328 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:52.956807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:52.956915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:52.975715 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] MFA Rules not processed for user `928feb4832ed4d42a765bdd393cbefa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:52.976882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:52.983796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1382/2777] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:56.069417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=30 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:02.970478 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:13.689889 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398f9c2-8ef9-4c67-b8c0-c42cb9ad2c51 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.690448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398f9c2-8ef9-4c67-b8c0-c42cb9ad2c51 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.690448 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398f9c2-8ef9-4c67-b8c0-c42cb9ad2c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.721396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4398f9c2-8ef9-4c67-b8c0-c42cb9ad2c51 None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:13.722621 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4398f9c2-8ef9-4c67-b8c0-c42cb9ad2c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.777565 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1396/2778] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 31 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:13.824401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.825992 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.894819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f8f4-cec3-4695-87ee-d975493566ab None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.899667 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.900261 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.900540 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.900810 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.908543 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.910175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.919831 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1383/2779] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:23.770410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=29 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:23.916611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=32 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:29.670805 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:29.671279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:29.671392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:29.723718 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] MFA Rules not processed for user `7f37e7598e29465ab6182da7ee0e4e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:29.725609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:29.742814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1397/2780] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 31 00:29:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:29.754930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:29.775218 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9f33d-2773-45e6-b3d6-49bc1cea6cc0 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:29.780158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '745d4cf142e24a7c9fb31af289f71fb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:29.780739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:29.781010 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:29.781274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:29.789965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:29.791431 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:29.799293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1384/2781] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 31 00:29:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:31.764742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.777685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33cbc8-c4d6-49b8-93bd-0fcdf01e9d6d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.784152 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.784788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.785063 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.785330 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] PATH_INFO: `/v3/users/928feb4832ed4d42a765bdd393cbefa6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.787009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=928feb4832ed4d42a765bdd393cbefa6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.789274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.838979 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928feb4832ed4d42a765bdd393cbefa6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.848293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928feb4832ed4d42a765bdd393cbefa6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.862217 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928feb4832ed4d42a765bdd393cbefa6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.862944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928feb4832ed4d42a765bdd393cbefa6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.869990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928feb4832ed4d42a765bdd393cbefa6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.875912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1398/2782] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:31 2022] DELETE /identity/v3/users/928feb4832ed4d42a765bdd393cbefa6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:32.050525 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:32.066124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4c81-c81a-476c-ad32-77033f31cb7b service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:32.124445 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:32.125059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:32.125332 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:32.125600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] PATH_INFO: `/v3/projects/a1a6554fb0f242c18cd475cad255d5c5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:32.126742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a6554fb0f242c18cd475cad255d5c5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:32.128637 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:32.173825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a6554fb0f242c18cd475cad255d5c5', 'request_id': 'req-fcf8218b-46f0-4792-90a0-a25351ec93be'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.179888 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a6554fb0f242c18cd475cad255d5c5', 'request_id': 'req-fcf8218b-46f0-4792-90a0-a25351ec93be'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.186350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a6554fb0f242c18cd475cad255d5c5', 'request_id': 'req-fcf8218b-46f0-4792-90a0-a25351ec93be'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.203044 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] The token cache is being invalidate because project a1a6554fb0f242c18cd475cad255d5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:32.203348 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.203979 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.205654 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1385/2783] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:32 2022] DELETE /identity/v3/projects/a1a6554fb0f242c18cd475cad255d5c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:35.181005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.182447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:35.237724 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa56de-f97d-4476-9e63-ade91766cf5f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.279655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.284591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.285195 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.285713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.286698 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.289204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:35.357964 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.359395 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.370563 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1399/2784] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:42.196488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:43.346082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:43.347482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:43.360133 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8218b-46f0-4792-90a0-a25351ec93be admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:43.363729 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:43.364320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:43.364600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:43.364873 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:43.366569 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:43.379635 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:43.381048 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f3658-addf-4337-8597-2eaa2e400cf8 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:43.391825 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1386/2785] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:45.365760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=32 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:47.653433 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:47.655853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:47.690348 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06042c07-020c-4137-a613-4e65ec18863f service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:47.696703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:47.697387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:47.697700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:47.698009 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:47.699771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:47.716365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:47.718667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:47.735916 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1400/2786] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:50.567196 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.567709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.567820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.586968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] MFA Rules not processed for user `988168279e8e495a985e209a35764f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:50.588172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.641040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1387/2787] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:29:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:51.259269 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.260757 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.330708 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9e41-ca6c-47e4-a36a-41aab31cb34b service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.336161 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.336762 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.337041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.337313 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.339153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.350960 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.352618 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.362575 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1401/2788] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:53.316550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.318049 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.376086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea8c3-57be-4996-b598-ffc38f56258f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.379624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.380259 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.380535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.380804 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.382559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.392148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.393624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.401792 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1388/2789] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:59.084266 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.085795 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:59.103165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8745b-d6fe-49e2-81e4-d65843aaed60 service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.108895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.109512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.109796 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.110113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.112196 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:59.126290 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.127921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.140360 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1402/2790] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:01.305883 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:01.319967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfd0d8-2c35-49c6-944e-80d0216a593e service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:01.325472 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:01.326140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:01.326420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:01.326694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:01.328433 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:01.387051 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:01.388622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:01.397661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1389/2791] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:04.504906 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.506794 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.519637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0939-5b11-4030-99c7-988eac95c389 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.523625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.524230 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.524509 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.524782 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.526838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.592548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.594045 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.604392 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1403/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:07.500381 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.502694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.518096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9870e1f-99ea-47c1-8a93-09eda7ad0a37 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.525806 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.526980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.527506 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.527780 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.529648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.543097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.544710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.556054 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1390/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:10.721115 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:10.722851 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:10.739933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5cda-744d-4042-9ef6-dc722edf3881 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:10.745243 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:10.746003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:10.746353 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:10.746700 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] PATH_INFO: `/v3/users/046c0674004e4747b4a365f26a5b8f5c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:10.747898 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] RBAC: Authorizing `identity:delete_user(user_id=046c0674004e4747b4a365f26a5b8f5c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:10.749999 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:10.811314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046c0674004e4747b4a365f26a5b8f5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.815608 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:10.819867 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046c0674004e4747b4a365f26a5b8f5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.835599 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046c0674004e4747b4a365f26a5b8f5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.836421 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046c0674004e4747b4a365f26a5b8f5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.846646 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046c0674004e4747b4a365f26a5b8f5c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.855420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1404/2794] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:10 2022] DELETE /identity/v3/users/046c0674004e4747b4a365f26a5b8f5c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:11.029545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:11.040913 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fca3b-2205-443f-9c22-4d54424b03cb service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:11.058927 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:11.101989 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:11.102634 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:11.102912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:11.103159 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] PATH_INFO: `/v3/projects/bb6e5312ca7c4188b95dcab2a6edc7c6` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:11.104258 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6e5312ca7c4188b95dcab2a6edc7c6)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:11.106176 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:11.151022 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'request_id': 'req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.157074 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'request_id': 'req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.162713 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6e5312ca7c4188b95dcab2a6edc7c6', 'request_id': 'req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.178524 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] The token cache is being invalidate because project bb6e5312ca7c4188b95dcab2a6edc7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:11.178814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.179439 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.180885 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1391/2795] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:11 2022] DELETE /identity/v3/projects/bb6e5312ca7c4188b95dcab2a6edc7c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:11.184865 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:11.186282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:11.199978 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e45bba-6ff8-4ff0-b160-9adda3b5d07b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:11.255602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:11.256223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:11.256505 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:11.256778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] PATH_INFO: `/v3/users/3e72de44bebe4df5843343ed0ae7b42e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:11.257931 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e72de44bebe4df5843343ed0ae7b42e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:11.259871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:11.306014 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e72de44bebe4df5843343ed0ae7b42e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.314298 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e72de44bebe4df5843343ed0ae7b42e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.326144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e72de44bebe4df5843343ed0ae7b42e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.326788 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e72de44bebe4df5843343ed0ae7b42e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.333578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e72de44bebe4df5843343ed0ae7b42e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.339450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1405/2796] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:11 2022] DELETE /identity/v3/users/3e72de44bebe4df5843343ed0ae7b42e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:11.510287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:11.511823 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:11.525266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d8a1-0a22-4aad-8c5f-9b1e31ccf321 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:11.582370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:11.583014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:11.583289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:11.583559 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] PATH_INFO: `/v3/projects/04f617f4468f420aaf76266d3282c5b4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:11.584651 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f617f4468f420aaf76266d3282c5b4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:11.586609 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:11.630162 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f617f4468f420aaf76266d3282c5b4', 'request_id': 'req-5fffbe98-1249-4d5d-9fcc-1ca060d29533'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.632126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:11.636519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f617f4468f420aaf76266d3282c5b4', 'request_id': 'req-5fffbe98-1249-4d5d-9fcc-1ca060d29533'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.643550 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f617f4468f420aaf76266d3282c5b4', 'request_id': 'req-5fffbe98-1249-4d5d-9fcc-1ca060d29533'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.656454 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] The token cache is being invalidate because project 04f617f4468f420aaf76266d3282c5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:11.656743 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.657360 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.658893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1392/2797] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:11 2022] DELETE /identity/v3/projects/04f617f4468f420aaf76266d3282c5b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:21.336000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:21.653596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=5,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:38.230856 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:38.232327 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:38.315278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75af8c-459c-4621-abc0-095f24c7dd25 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:38.376955 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:38.377558 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:38.377838 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:38.378133 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:38.379957 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:38.391537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:38.393114 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:38.403554 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1406/2798] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:39.008990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:39.010455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:39.026253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffbe98-1249-4d5d-9fcc-1ca060d29533 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:39.031915 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:39.032505 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:39.032779 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:39.033043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:39.035228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:39.093533 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:39.095168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:39.108934 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1393/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:41.104271 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:41.105665 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:41.161315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8c25b-da7b-4337-9f46-bac7ea5a239d service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:41.165142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:41.165738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:41.166055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:41.166329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:41.168035 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:41.206146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:41.236946 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:41.239043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:41.248512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1407/2800] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:47.475200 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:47.477515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:47.498589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1654d-98f3-4fdf-843d-514796bdf6b2 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:47.503285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:47.503957 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:47.504237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:47.504510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] PATH_INFO: `/v3/users/5d8054341c0e46778e3b3db0b3dd1164` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:47.505647 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8054341c0e46778e3b3db0b3dd1164)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:47.507677 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:47.562496 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8054341c0e46778e3b3db0b3dd1164'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.563160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8054341c0e46778e3b3db0b3dd1164'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.563869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8054341c0e46778e3b3db0b3dd1164'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.575946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8054341c0e46778e3b3db0b3dd1164'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.582762 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8054341c0e46778e3b3db0b3dd1164'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.594744 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1394/2801] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:47 2022] DELETE /identity/v3/users/5d8054341c0e46778e3b3db0b3dd1164 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:47.762996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:47.773778 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a82d56-13c1-460e-b49e-cded23ea7865 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:47.830523 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:47.831144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:47.831935 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:47.832204 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] PATH_INFO: `/v3/projects/167da5798ea2451a9888a661b3c7f3e6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:47.833296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167da5798ea2451a9888a661b3c7f3e6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:47.835207 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:47.883288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167da5798ea2451a9888a661b3c7f3e6', 'request_id': 'req-e6baa89c-af2b-4b95-85ad-25f56caf6016'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.889384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167da5798ea2451a9888a661b3c7f3e6', 'request_id': 'req-e6baa89c-af2b-4b95-85ad-25f56caf6016'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.895344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167da5798ea2451a9888a661b3c7f3e6', 'request_id': 'req-e6baa89c-af2b-4b95-85ad-25f56caf6016'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.907168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] The token cache is being invalidate because project 167da5798ea2451a9888a661b3c7f3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:47.907458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.908146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:47.910311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1408/2802] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:47 2022] DELETE /identity/v3/projects/167da5798ea2451a9888a661b3c7f3e6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:47.914585 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:47.916041 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:47.929401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4c854-048e-49aa-93f4-134d64ccf811 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:47.983943 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:47.984555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:47.984830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:47.985096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] PATH_INFO: `/v3/users/3d02e834967b4b2a96e92fc4183bce56` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:47.986233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d02e834967b4b2a96e92fc4183bce56)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:47.988172 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:47.999969 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:48.032880 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d02e834967b4b2a96e92fc4183bce56'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.033517 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d02e834967b4b2a96e92fc4183bce56'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.034139 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d02e834967b4b2a96e92fc4183bce56'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.047122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d02e834967b4b2a96e92fc4183bce56'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.057827 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d02e834967b4b2a96e92fc4183bce56'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.072187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1395/2803] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:47 2022] DELETE /identity/v3/users/3d02e834967b4b2a96e92fc4183bce56 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:48.241287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:48.242881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:48.263551 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baa89c-af2b-4b95-85ad-25f56caf6016 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:48.335319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:48.336235 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:48.336510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:48.336783 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] PATH_INFO: `/v3/projects/40b1228034f841ce92abeef3afe3e871` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:48.338034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b1228034f841ce92abeef3afe3e871)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:48.339938 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:48.346776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:48.402055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b1228034f841ce92abeef3afe3e871', 'request_id': 'req-a170ff1e-8344-49ac-997e-f6d65903f202'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.409030 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b1228034f841ce92abeef3afe3e871', 'request_id': 'req-a170ff1e-8344-49ac-997e-f6d65903f202'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.417934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b1228034f841ce92abeef3afe3e871', 'request_id': 'req-a170ff1e-8344-49ac-997e-f6d65903f202'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.436319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] The token cache is being invalidate because project 40b1228034f841ce92abeef3afe3e871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:48.436654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.439713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:48.441880 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1409/2804] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:48 2022] DELETE /identity/v3/projects/40b1228034f841ce92abeef3afe3e871 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:57.799768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:57.801257 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:57.857471 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a37cd-7c1d-413a-b3ef-5ab3cbbb0cff admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:57.906270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:57.906869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:57.907146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:57.907417 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:57.909287 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:57.967446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:57.970086 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:57.972422 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:57.982942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1396/2805] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:58.430241 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:01.067586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.069164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:01.082749 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170ff1e-8344-49ac-997e-f6d65903f202 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.087904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.088545 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.088808 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.089377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] PATH_INFO: `/v3/users/988168279e8e495a985e209a35764f2b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.090542 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] RBAC: Authorizing `identity:delete_user(user_id=988168279e8e495a985e209a35764f2b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.092445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.139438 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988168279e8e495a985e209a35764f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.146832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988168279e8e495a985e209a35764f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.158760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988168279e8e495a985e209a35764f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.159419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988168279e8e495a985e209a35764f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.166555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4fe0a185-2f1e-43ee-86eb-2fbfd9ec558b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988168279e8e495a985e209a35764f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.172338 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1410/2806] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:01 2022] DELETE /identity/v3/users/988168279e8e495a985e209a35764f2b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:01.342889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.352930 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6fd5-eb11-4331-819f-b25ebde32a48 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.410684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.411306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.411582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.411854 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] PATH_INFO: `/v3/projects/8f133f3096eb472d9a3c98ea9b81c1b9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.412964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f133f3096eb472d9a3c98ea9b81c1b9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.415146 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.464278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f133f3096eb472d9a3c98ea9b81c1b9', 'request_id': 'req-08325952-b235-4f22-820a-f72ce2f15538'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.470271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f133f3096eb472d9a3c98ea9b81c1b9', 'request_id': 'req-08325952-b235-4f22-820a-f72ce2f15538'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.476266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f133f3096eb472d9a3c98ea9b81c1b9', 'request_id': 'req-08325952-b235-4f22-820a-f72ce2f15538'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.488488 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] The token cache is being invalidate because project 8f133f3096eb472d9a3c98ea9b81c1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:01.488771 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.489384 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-08325952-b235-4f22-820a-f72ce2f15538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:01.490897 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1397/2807] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:01 2022] DELETE /identity/v3/projects/8f133f3096eb472d9a3c98ea9b81c1b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:01.495831 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.496116 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.496390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.515801 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:01.516998 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:01.574846 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1411/2808] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:01.583954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.584236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.584507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.603547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:01.604739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:01.612437 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1398/2809] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:01.616439 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.626066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c030-e9af-450e-8c31-ddb4b3272f01 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.631187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.631776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.632059 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.632336 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.632976 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:31:01.633279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.634923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.646857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1412/2810] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:31:01.651085 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.660106 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1c70-0210-4ee3-9329-e87fbc63196b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.664912 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.665493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.665769 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.666070 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.666693 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.668570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.704570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1399/2811] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:01 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:31:01.709226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.718962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5147b3f-b03e-4b6f-a2da-8ddf38b4a4a3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.775466 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.776066 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.776376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.776647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.777270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.779268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.787517 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:01.802065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1413/2812] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:01 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:01.806076 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.816557 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b3b4-c1ec-445f-9cbd-b9a501da62c4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.821053 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.821641 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.822024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.822301 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.822938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.824526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.835124 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1400/2813] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:01.838858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.848986 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d0a60-dfd2-4ccf-8e3f-3c19d9f126a6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.853602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd3702-5f28-45e2-a6ad-6da02c8acdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.854312 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd3702-5f28-45e2-a6ad-6da02c8acdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.854520 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd3702-5f28-45e2-a6ad-6da02c8acdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.854774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd3702-5f28-45e2-a6ad-6da02c8acdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.855410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd3702-5f28-45e2-a6ad-6da02c8acdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.856993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd3702-5f28-45e2-a6ad-6da02c8acdc6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.869054 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1414/2814] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:01.872739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:01.883285 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47eb41-5549-4e1d-a9d7-4f98ba21f324 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.888148 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.888819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.889097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.889372 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] PATH_INFO: `/v3/projects/984dddeb4980485c93de858c94d8a0f0/users/c9ab0a20f09e419ca92f195157e029da/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.904507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984dddeb4980485c93de858c94d8a0f0, user_id=c9ab0a20f09e419ca92f195157e029da, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.907201 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.920973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1401/2815] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:01 2022] PUT /identity/v3/projects/984dddeb4980485c93de858c94d8a0f0/users/c9ab0a20f09e419ca92f195157e029da/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:01.931736 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.932021 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.932295 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.959934 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] MFA Rules not processed for user `c9ab0a20f09e419ca92f195157e029da`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:01.961165 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:02.024444 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1415/2816] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:02.035001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:02.036665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:02.051424 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:02.094901 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b6df-f13b-460a-b4a7-8e1fc5b18e28 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:02.099073 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e39eab-f885-481b-9ffd-1e9de5499b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:02.099668 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e39eab-f885-481b-9ffd-1e9de5499b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:02.099945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e39eab-f885-481b-9ffd-1e9de5499b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:02.100214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e39eab-f885-481b-9ffd-1e9de5499b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:02.108290 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e39eab-f885-481b-9ffd-1e9de5499b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:02.109705 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e39eab-f885-481b-9ffd-1e9de5499b7e service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:02.118398 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1402/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:10.468584 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:10.529635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c02baa-a456-4a07-acf9-5a651fb9643d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:10.534248 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:10.534869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:10.535146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:10.535461 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] PATH_INFO: `/v3/users/c9ab0a20f09e419ca92f195157e029da` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:10.536512 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ab0a20f09e419ca92f195157e029da)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:10.538707 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:10.583223 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ab0a20f09e419ca92f195157e029da'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:10.590373 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ab0a20f09e419ca92f195157e029da'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:10.601105 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:10.602310 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ab0a20f09e419ca92f195157e029da'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:10.603137 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ab0a20f09e419ca92f195157e029da'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:10.611697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ab0a20f09e419ca92f195157e029da'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:10.617925 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1416/2818] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:10 2022] DELETE /identity/v3/users/c9ab0a20f09e419ca92f195157e029da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:10.622277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:10.622799 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:10.622919 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:10.641082 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:10.642313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:10.706813 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1403/2819] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:10.716709 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:10.718143 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:10.776191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5da94-61bb-4a6d-b841-a2d4fc40e1f1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:10.779855 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b746-7a29-4f24-a59e-eec9dc775a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:10.780459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b746-7a29-4f24-a59e-eec9dc775a22 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:10.780739 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b746-7a29-4f24-a59e-eec9dc775a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:10.781011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b746-7a29-4f24-a59e-eec9dc775a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:10.794125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6b746-7a29-4f24-a59e-eec9dc775a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:10.795503 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6b746-7a29-4f24-a59e-eec9dc775a22 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:10.805430 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1417/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:11.082735 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.084163 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:11.098078 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de160b-8ea8-4873-988a-e859e8e5a799 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.103462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.104342 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.104761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.105242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] PATH_INFO: `/v3/projects/984dddeb4980485c93de858c94d8a0f0` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.106710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984dddeb4980485c93de858c94d8a0f0)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.108695 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.154892 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984dddeb4980485c93de858c94d8a0f0', 'request_id': 'req-d34f9c77-2a05-46a9-9481-9177327513f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:11.161449 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984dddeb4980485c93de858c94d8a0f0', 'request_id': 'req-d34f9c77-2a05-46a9-9481-9177327513f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:11.167350 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984dddeb4980485c93de858c94d8a0f0', 'request_id': 'req-d34f9c77-2a05-46a9-9481-9177327513f4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:11.180466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] The token cache is being invalidate because project 984dddeb4980485c93de858c94d8a0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:11.180757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:11.181388 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d34f9c77-2a05-46a9-9481-9177327513f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:11.182929 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1404/2821] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:11 2022] DELETE /identity/v3/projects/984dddeb4980485c93de858c94d8a0f0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:11.188210 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.188496 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.188774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.208601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:11.209797 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:11.267308 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1418/2822] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:11.274938 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.275227 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.275527 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.295443 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:11.296649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:11.305302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1405/2823] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:11.309349 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.318945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c0f65-7178-49a6-89ef-854432c461f8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.323453 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.324046 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.324329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.324604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.325250 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:31:11.325610 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.327190 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.340813 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1419/2824] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:31:11.344933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.354781 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a1347-dcf2-475f-9582-9cd4d8c203ac None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.359425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.360018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.360296 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.360567 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.361217 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.363171 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.394380 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1406/2825] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:11 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:11.402072 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.412420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6159-0b77-4f7f-85c9-20ef2d62c237 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.466536 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.467127 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.467402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.467671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.468296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.470247 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.491522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1420/2826] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:11 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:11.495710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.505836 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d2f31-d31a-4e9d-99ee-ef42b82c079b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.510415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.510993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.511268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.511535 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.512170 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.513752 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.519661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.525197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1407/2827] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:11.529044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.539606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d9f87-012c-4f88-843e-1c381a156804 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.544218 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33172972-adea-4a37-b624-21654d39b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.544809 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172972-adea-4a37-b624-21654d39b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.545092 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172972-adea-4a37-b624-21654d39b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.545368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33172972-adea-4a37-b624-21654d39b2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.546041 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172972-adea-4a37-b624-21654d39b2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.547637 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33172972-adea-4a37-b624-21654d39b2d6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.548881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.559878 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1421/2828] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:11.563829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.573694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec368-a139-433f-9946-abb1a9e408ea admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.578365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.578951 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.579235 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.579509 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] PATH_INFO: `/v3/projects/86d3bb0eb86e4d4d969a7d6fba2efbc2/users/5407f15ad3d247339b0e5eacb0feb994/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.594611 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d3bb0eb86e4d4d969a7d6fba2efbc2, user_id=5407f15ad3d247339b0e5eacb0feb994, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.597375 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.609490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1408/2829] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:11 2022] PUT /identity/v3/projects/86d3bb0eb86e4d4d969a7d6fba2efbc2/users/5407f15ad3d247339b0e5eacb0feb994/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:11.621413 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.621722 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.622034 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.649384 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] MFA Rules not processed for user `5407f15ad3d247339b0e5eacb0feb994`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:11.650615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:11.715609 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1422/2830] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:11.728655 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:11.730870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:11.804274 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceddb0-f075-468f-8894-0457f315607b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:11.809833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e646b-8ce0-4201-8157-faeb0697a200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d50090e8a924a76b634807f00734c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:11.810455 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e646b-8ce0-4201-8157-faeb0697a200 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:11.810734 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e646b-8ce0-4201-8157-faeb0697a200 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:11.811005 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e646b-8ce0-4201-8157-faeb0697a200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:11.819099 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e646b-8ce0-4201-8157-faeb0697a200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:11.820680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e646b-8ce0-4201-8157-faeb0697a200 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:11.829389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1409/2831] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:12.050410 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:12.232879 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dbdd2-b918-4f3f-a06d-ec96584705b9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:12.237391 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:12.238040 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:12.238319 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:12.238589 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] PATH_INFO: `/v3/users/5407f15ad3d247339b0e5eacb0feb994` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:12.239694 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5407f15ad3d247339b0e5eacb0feb994)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:12.241593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:12.286447 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5407f15ad3d247339b0e5eacb0feb994'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.294981 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5407f15ad3d247339b0e5eacb0feb994'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.306751 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5407f15ad3d247339b0e5eacb0feb994'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.307397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5407f15ad3d247339b0e5eacb0feb994'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.314131 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5407f15ad3d247339b0e5eacb0feb994'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.319933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1423/2832] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:12 2022] DELETE /identity/v3/users/5407f15ad3d247339b0e5eacb0feb994 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:12.324541 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:12.324851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:12.325126 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:12.344306 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:12.345511 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:12.402516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1410/2833] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:12.412719 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:12.414431 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:12.420776 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:12.473254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b66443-ff89-4db4-9273-cb5e7f10b7db admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:12.476987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c4a7-7e32-4757-b539-9af042f2d3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:12.477588 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c4a7-7e32-4757-b539-9af042f2d3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:12.477886 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c4a7-7e32-4757-b539-9af042f2d3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:12.478164 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c4a7-7e32-4757-b539-9af042f2d3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:12.487003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c4a7-7e32-4757-b539-9af042f2d3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:12.488924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c4a7-7e32-4757-b539-9af042f2d3a5 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:12.498073 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1424/2834] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:12.774334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:12.775890 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:12.787993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aec35-045c-4828-ac93-81bdc1dd3b5b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:12.793011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:12.793638 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:12.794161 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:12.794475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] PATH_INFO: `/v3/projects/86d3bb0eb86e4d4d969a7d6fba2efbc2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:12.795622 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d3bb0eb86e4d4d969a7d6fba2efbc2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:12.797949 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:12.848142 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d3bb0eb86e4d4d969a7d6fba2efbc2', 'request_id': 'req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.854152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d3bb0eb86e4d4d969a7d6fba2efbc2', 'request_id': 'req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.856127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:12.864108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d3bb0eb86e4d4d969a7d6fba2efbc2', 'request_id': 'req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.877680 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] The token cache is being invalidate because project 86d3bb0eb86e4d4d969a7d6fba2efbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:12.878032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.878639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3efd5b0e-b43b-4246-8e02-2f51d6dcadcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:12.880120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1411/2835] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:12 2022] DELETE /identity/v3/projects/86d3bb0eb86e4d4d969a7d6fba2efbc2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:12.884874 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:12.885153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:12.885419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:12.904676 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:12.905876 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:12.963211 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1425/2836] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:12.970871 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:12.971154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:12.971427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:12.995648 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:12.998983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:13.009577 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1412/2837] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:13.013904 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.023437 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287b12a-2dd7-4b1f-8395-12d78cc0dd08 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.027908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.028489 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.028764 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.029031 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.029667 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:31:13.030005 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.031591 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.042873 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1426/2838] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:31:13.047256 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.057232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b34b9-1e76-4c52-8460-516d647f2009 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.062068 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.062665 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.062942 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.063211 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.063828 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.066310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.094526 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1413/2839] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:13 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:31:13.098672 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.108376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74942f8-c6ef-43f3-bf91-b7fea7d50d97 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.165331 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.165968 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.166249 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.166518 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.167139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.169071 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.191343 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1427/2840] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:13 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:13.195568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.205807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274997-2a79-470c-a41c-79c08843de39 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.210413 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.211001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.211275 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.211570 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.212204 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.213822 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.224083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1414/2841] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:13.227686 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.237780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7fd3-1887-4627-9f99-599e507859fc admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.242423 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdeb98-1b5a-4df1-b2ac-1bc5ea9a396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.243006 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdeb98-1b5a-4df1-b2ac-1bc5ea9a396d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.243278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdeb98-1b5a-4df1-b2ac-1bc5ea9a396d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.243548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdeb98-1b5a-4df1-b2ac-1bc5ea9a396d admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.244179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdeb98-1b5a-4df1-b2ac-1bc5ea9a396d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.245754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdeb98-1b5a-4df1-b2ac-1bc5ea9a396d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.255479 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1428/2842] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:13.259427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.269030 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aecbd6-5755-42e7-8764-0f4c46d8e85c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.273963 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.274612 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.274889 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.275187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] PATH_INFO: `/v3/projects/b454669d3c6643e8b45a787649f9865a/users/4bb5fefd27f748afaee902c3442075a3/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.290308 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b454669d3c6643e8b45a787649f9865a, user_id=4bb5fefd27f748afaee902c3442075a3, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.292954 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.306279 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1415/2843] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:13 2022] PUT /identity/v3/projects/b454669d3c6643e8b45a787649f9865a/users/4bb5fefd27f748afaee902c3442075a3/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:31:13.317711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.318036 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.318311 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.342508 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:13.345593 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] MFA Rules not processed for user `4bb5fefd27f748afaee902c3442075a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:13.347993 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:13.411193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1429/2844] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:13.415978 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.474893 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ba6d-e923-4caf-8ecf-934f3c9df866 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.479442 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.480024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.480299 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.480568 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.481197 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.483088 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.509167 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1416/2845] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:13 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:13.513173 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.525335 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7f73-e10e-4a4b-8fcb-188b4993f2a2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.582475 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.583079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.583361 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.583655 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.584279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.586246 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.606660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1430/2846] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:13 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:13.610878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.621545 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a2da-3360-4c7f-aa62-f70a83c784ba admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.626083 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.626670 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.626946 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.627214 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.628415 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.630036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.640223 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1417/2847] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:13.644526 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.654442 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4e0f-606c-4ff2-a415-3918ad0e279d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.659049 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.659693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.659972 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.660245 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] PATH_INFO: `/v3/projects/9a6950f1a6fe4172b614d75b97cb5068/users/03605fce618e4b5589b60ddcca43ef11/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.676239 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6950f1a6fe4172b614d75b97cb5068, user_id=03605fce618e4b5589b60ddcca43ef11, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.678930 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.691180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1431/2848] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:13 2022] PUT /identity/v3/projects/9a6950f1a6fe4172b614d75b97cb5068/users/03605fce618e4b5589b60ddcca43ef11/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:13.695193 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.705103 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775aa28-f302-4faa-8e23-77258c180637 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.753208 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:13.760987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378f960-6a23-4e90-a87f-943a68faf932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.761549 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378f960-6a23-4e90-a87f-943a68faf932 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.761830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378f960-6a23-4e90-a87f-943a68faf932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.762305 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378f960-6a23-4e90-a87f-943a68faf932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.763097 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378f960-6a23-4e90-a87f-943a68faf932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.764923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378f960-6a23-4e90-a87f-943a68faf932 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.775006 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1418/2849] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:13.779226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.790198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb75f60-f1a0-4c00-b735-80cb3b5ce8a1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.794754 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.795396 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.795674 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.795945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] PATH_INFO: `/v3/projects/9a6950f1a6fe4172b614d75b97cb5068/users/03605fce618e4b5589b60ddcca43ef11/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.797871 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6950f1a6fe4172b614d75b97cb5068, user_id=03605fce618e4b5589b60ddcca43ef11, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.800983 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.810899 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1432/2850] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:13 2022] PUT /identity/v3/projects/9a6950f1a6fe4172b614d75b97cb5068/users/03605fce618e4b5589b60ddcca43ef11/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:13.872796 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.873081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.873357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.900732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] MFA Rules not processed for user `03605fce618e4b5589b60ddcca43ef11`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:13.901959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:13.967377 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1419/2851] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:13.977866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.979582 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:14.035254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837887-86c1-44a6-976d-4f3b988a410a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:14.039051 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed4784-5aaf-46ad-929a-50be12bf5d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:14.039642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4784-5aaf-46ad-929a-50be12bf5d4e service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.039921 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4784-5aaf-46ad-929a-50be12bf5d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.040191 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4784-5aaf-46ad-929a-50be12bf5d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.048917 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed4784-5aaf-46ad-929a-50be12bf5d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:14.050515 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed4784-5aaf-46ad-929a-50be12bf5d4e service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:14.054389 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:14.061332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1433/2852] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:14.208055 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:14.267556 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e394e2-c9f2-44d9-9d1f-55ca36386559 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:14.272552 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:14.273155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.273427 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.273694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] PATH_INFO: `/v3/users/4bb5fefd27f748afaee902c3442075a3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.274801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb5fefd27f748afaee902c3442075a3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:14.276688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:14.323768 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb5fefd27f748afaee902c3442075a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.324420 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb5fefd27f748afaee902c3442075a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.325033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb5fefd27f748afaee902c3442075a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.337237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb5fefd27f748afaee902c3442075a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.344110 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb5fefd27f748afaee902c3442075a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.349798 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:14.358108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1420/2853] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:14 2022] DELETE /identity/v3/users/4bb5fefd27f748afaee902c3442075a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:14.363278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.363635 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.363910 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.382183 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:14.383371 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:14.447039 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1434/2854] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:31:14.457271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:14.458911 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:14.515468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d41e19-a54f-4aa7-9177-9d7def1b6576 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:14.519114 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:14.519710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.519987 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.520260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.530973 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:14.532411 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:14.542232 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1421/2855] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:14.814094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:14.815569 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:14.831314 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499b2d-ce18-441a-9c9a-6ff066ffee89 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:14.836555 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:14.837197 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.837586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.837742 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] PATH_INFO: `/v3/projects/b454669d3c6643e8b45a787649f9865a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.838929 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b454669d3c6643e8b45a787649f9865a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:14.840844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:14.889387 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b454669d3c6643e8b45a787649f9865a', 'request_id': 'req-411fee20-ede0-4d70-83dd-be509ad6bb52'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.895441 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b454669d3c6643e8b45a787649f9865a', 'request_id': 'req-411fee20-ede0-4d70-83dd-be509ad6bb52'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.901275 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b454669d3c6643e8b45a787649f9865a', 'request_id': 'req-411fee20-ede0-4d70-83dd-be509ad6bb52'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.914595 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] The token cache is being invalidate because project b454669d3c6643e8b45a787649f9865a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:14.914887 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.915511 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:14.916977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1435/2856] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:14 2022] DELETE /identity/v3/projects/b454669d3c6643e8b45a787649f9865a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:14.920995 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:14.931040 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3cc34-0ddd-4c1f-8c9c-98fdd7ba00e6 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:14.984516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:14.985127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.985406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.985682 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] PATH_INFO: `/v3/users/03605fce618e4b5589b60ddcca43ef11` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.986830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03605fce618e4b5589b60ddcca43ef11)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:14.989284 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.033499 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03605fce618e4b5589b60ddcca43ef11'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.034666 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03605fce618e4b5589b60ddcca43ef11'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.035278 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03605fce618e4b5589b60ddcca43ef11'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.047391 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03605fce618e4b5589b60ddcca43ef11'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.055732 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62bf9d92-95d8-4a82-a382-56db8aae7e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03605fce618e4b5589b60ddcca43ef11'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.067980 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1422/2857] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:14 2022] DELETE /identity/v3/users/03605fce618e4b5589b60ddcca43ef11 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:31:15.336711 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.338276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:15.352734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fee20-ede0-4d70-83dd-be509ad6bb52 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.410746 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.411366 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.411638 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.411918 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] PATH_INFO: `/v3/projects/9a6950f1a6fe4172b614d75b97cb5068` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.412992 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6950f1a6fe4172b614d75b97cb5068)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.415187 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.439088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:15.462657 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6950f1a6fe4172b614d75b97cb5068', 'request_id': 'req-0974832f-0597-42de-bafa-8a49987a805e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.468942 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6950f1a6fe4172b614d75b97cb5068', 'request_id': 'req-0974832f-0597-42de-bafa-8a49987a805e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.474470 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6950f1a6fe4172b614d75b97cb5068', 'request_id': 'req-0974832f-0597-42de-bafa-8a49987a805e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.486094 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] The token cache is being invalidate because project 9a6950f1a6fe4172b614d75b97cb5068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:15.486385 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.486997 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0974832f-0597-42de-bafa-8a49987a805e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:15.488456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1436/2858] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:15 2022] DELETE /identity/v3/projects/9a6950f1a6fe4172b614d75b97cb5068 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:15.493264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.493547 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.493820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.513681 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:15.514922 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:15.526877 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:15.575091 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1423/2859] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:15.583315 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.583616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.583896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.603244 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:15.604456 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:15.612398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1437/2860] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:15.616461 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.626155 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e566df-78b7-4ef3-9772-6ca214249d2d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.631160 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.631747 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.632021 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.632288 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.632925 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:31:15.633225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.634833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.646684 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1424/2861] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:31:15.651379 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.660573 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c840be-5bc5-4790-b71e-5844f09f8de5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.665648 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.666276 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.666556 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.666829 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.667457 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.669370 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.696299 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1438/2862] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:15 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:15.700421 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.710910 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc6df0-f9fb-4e4c-a373-54bea0cc4c00 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.766260 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.766848 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.767135 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.767410 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.768029 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.770507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.791127 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1425/2863] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:15 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:15.795198 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.805952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9dce5-6ec8-486a-8857-2ab0aa30fa79 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.810400 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.810984 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.811283 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.811549 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.812179 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.813741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.823923 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1439/2864] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:15.827962 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.838586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e74f2-8096-4732-ba4f-6ef4a3220bde admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.843168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac1293-a162-4e71-9736-6357a6a0bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.843756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac1293-a162-4e71-9736-6357a6a0bbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.844036 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac1293-a162-4e71-9736-6357a6a0bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.844310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac1293-a162-4e71-9736-6357a6a0bbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.844945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac1293-a162-4e71-9736-6357a6a0bbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.846624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac1293-a162-4e71-9736-6357a6a0bbfd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.857182 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1426/2865] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:15.861121 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:15.871891 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a91ae-9c73-420b-82f0-b0e074665d9c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:15.876559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:15.877316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.877596 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.878440 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] PATH_INFO: `/v3/projects/a864d294a60d406eb39ea64b6f0de0fb/users/011aa3c91a724e8ba8d49a8c6d4390bf/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.892774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a864d294a60d406eb39ea64b6f0de0fb, user_id=011aa3c91a724e8ba8d49a8c6d4390bf, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:15.895510 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:15.908117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1440/2866] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:15 2022] PUT /identity/v3/projects/a864d294a60d406eb39ea64b6f0de0fb/users/011aa3c91a724e8ba8d49a8c6d4390bf/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:15.919615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:15.919899 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:15.920173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:15.947731 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] MFA Rules not processed for user `011aa3c91a724e8ba8d49a8c6d4390bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:15.948945 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:16.010446 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1427/2867] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:31:16.015065 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.075777 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551e42-c74c-4b81-b874-85ea90e77a24 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.080399 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.081522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.081804 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.082113 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.082738 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.084642 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.110848 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1441/2868] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:16 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:31:16.115367 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.126043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d30ee4-f08d-4345-ad9d-fdd8f71b8fd8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.135033 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:16.181676 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.182317 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.182598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.182870 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.183487 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.185412 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.205111 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1428/2869] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:16 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:16.209142 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.219445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80b3c-a381-48aa-9243-5f8560827617 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.224670 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.225263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.225537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.225827 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.226483 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.228064 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.239278 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1442/2870] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:16.243249 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.253397 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be40ab-11dd-4c4b-aadb-9f5d9bca401e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.257952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.258587 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.258862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.259132 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] PATH_INFO: `/v3/projects/b58f3b69018547d8a0fc7cfe6d3469c5/users/8937466015554974b6ace403137b4501/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.274843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58f3b69018547d8a0fc7cfe6d3469c5, user_id=8937466015554974b6ace403137b4501, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.277468 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.290334 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1429/2871] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:16 2022] PUT /identity/v3/projects/b58f3b69018547d8a0fc7cfe6d3469c5/users/8937466015554974b6ace403137b4501/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:16.294280 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.304112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ddc3b-459b-4fc3-afdb-d26288377095 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.321996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:16.361287 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdbb63-9521-48f8-94a0-2da1801f33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.361817 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdbb63-9521-48f8-94a0-2da1801f33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.362132 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdbb63-9521-48f8-94a0-2da1801f33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.362405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdbb63-9521-48f8-94a0-2da1801f33a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.363038 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdbb63-9521-48f8-94a0-2da1801f33a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.364625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdbb63-9521-48f8-94a0-2da1801f33a4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.374185 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1443/2872] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:16.378882 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.388851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503debff-759d-47c0-baca-fcaa4c5f92e6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.393406 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.394079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.394355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.394627 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] PATH_INFO: `/v3/projects/b58f3b69018547d8a0fc7cfe6d3469c5/users/8937466015554974b6ace403137b4501/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.396507 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58f3b69018547d8a0fc7cfe6d3469c5, user_id=8937466015554974b6ace403137b4501, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.399187 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.409589 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1430/2873] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:16 2022] PUT /identity/v3/projects/b58f3b69018547d8a0fc7cfe6d3469c5/users/8937466015554974b6ace403137b4501/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:16.419866 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.420153 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.420425 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.447894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] MFA Rules not processed for user `8937466015554974b6ace403137b4501`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:16.449112 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:16.515160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1444/2874] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:16.526180 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.527864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:16.584710 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad1762-4dc0-4be8-bceb-0cf6ca4fb321 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.588314 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.588900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.589175 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.589444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.598245 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.599662 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.608802 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1431/2875] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:16.684125 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:16.694044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f962a-2550-4119-b4bc-e73e2e79b5ca None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:16.697586 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894bbe6-a699-487a-bc99-51d33e47fd78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:16.698215 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bbe6-a699-487a-bc99-51d33e47fd78 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:16.698491 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bbe6-a699-487a-bc99-51d33e47fd78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:16.698760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bbe6-a699-487a-bc99-51d33e47fd78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:16.753677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894bbe6-a699-487a-bc99-51d33e47fd78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:16.755134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894bbe6-a699-487a-bc99-51d33e47fd78 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:16.763814 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1445/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:25.574014 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:25.634555 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924f9e-b6e3-4a02-9f19-d29fefd56ac3 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:25.638990 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:25.639601 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:25.639878 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:25.640149 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] PATH_INFO: `/v3/users/011aa3c91a724e8ba8d49a8c6d4390bf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:25.641253 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011aa3c91a724e8ba8d49a8c6d4390bf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:25.643690 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:25.653302 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:25.688600 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011aa3c91a724e8ba8d49a8c6d4390bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:25.689250 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011aa3c91a724e8ba8d49a8c6d4390bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:25.689864 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011aa3c91a724e8ba8d49a8c6d4390bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:25.701453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011aa3c91a724e8ba8d49a8c6d4390bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:25.708917 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011aa3c91a724e8ba8d49a8c6d4390bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:25.720819 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1432/2877] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:25 2022] DELETE /identity/v3/users/011aa3c91a724e8ba8d49a8c6d4390bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:25.726016 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:25.726484 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:25.726606 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:25.745138 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:25.746417 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:25.784568 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:25.806172 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1446/2878] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:25.816704 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:25.818168 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:25.875457 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6280b6-baf5-4493-9c68-e80e7f1d6b95 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:25.879607 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:25.880202 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:25.880475 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:25.880739 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:25.889516 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:25.890898 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:25.900001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1433/2879] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:26.162368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:26.164119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:26.176119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7348-859c-4b72-a126-4ad703a4ba23 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:26.180679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:26.181307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.181587 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.181881 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] PATH_INFO: `/v3/projects/a864d294a60d406eb39ea64b6f0de0fb` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.183022 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a864d294a60d406eb39ea64b6f0de0fb)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:26.184944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:26.232134 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a864d294a60d406eb39ea64b6f0de0fb', 'request_id': 'req-f4dacba3-f3c5-46f7-b457-010aa6a231d1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.238296 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a864d294a60d406eb39ea64b6f0de0fb', 'request_id': 'req-f4dacba3-f3c5-46f7-b457-010aa6a231d1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.243858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a864d294a60d406eb39ea64b6f0de0fb', 'request_id': 'req-f4dacba3-f3c5-46f7-b457-010aa6a231d1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.255857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] The token cache is being invalidate because project a864d294a60d406eb39ea64b6f0de0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:26.256146 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.256760 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.258282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1447/2880] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:26 2022] DELETE /identity/v3/projects/a864d294a60d406eb39ea64b6f0de0fb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:26.262209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:26.272081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea158d-191f-4221-b962-ab17af6197ef service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:26.326923 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:26.327538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.327812 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.328079 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] PATH_INFO: `/v3/users/8937466015554974b6ace403137b4501` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.329173 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8937466015554974b6ace403137b4501)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:26.331594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:26.364571 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:26.377765 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8937466015554974b6ace403137b4501'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.378429 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8937466015554974b6ace403137b4501'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.379028 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8937466015554974b6ace403137b4501'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.390588 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8937466015554974b6ace403137b4501'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.397991 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04bed995-3f88-409d-bd6e-6917415fd643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8937466015554974b6ace403137b4501'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.410818 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1434/2881] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:26 2022] DELETE /identity/v3/users/8937466015554974b6ace403137b4501 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:26.676894 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:26.678341 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:26.691522 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dacba3-f3c5-46f7-b457-010aa6a231d1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:26.747177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:26.747844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.748124 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.748424 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] PATH_INFO: `/v3/projects/b58f3b69018547d8a0fc7cfe6d3469c5` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.749574 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58f3b69018547d8a0fc7cfe6d3469c5)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:26.751559 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:26.801171 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58f3b69018547d8a0fc7cfe6d3469c5', 'request_id': 'req-0b27de2d-3ea9-4380-90e1-47786da097c4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.807302 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58f3b69018547d8a0fc7cfe6d3469c5', 'request_id': 'req-0b27de2d-3ea9-4380-90e1-47786da097c4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.812815 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58f3b69018547d8a0fc7cfe6d3469c5', 'request_id': 'req-0b27de2d-3ea9-4380-90e1-47786da097c4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.817095 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:26.828077 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] The token cache is being invalidate because project b58f3b69018547d8a0fc7cfe6d3469c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:26.828377 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.829288 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0b27de2d-3ea9-4380-90e1-47786da097c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:26.831020 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1448/2882] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:26 2022] DELETE /identity/v3/projects/b58f3b69018547d8a0fc7cfe6d3469c5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:26.835775 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.836242 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.836346 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.855659 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:26.856865 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:26.916011 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1435/2883] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:26.923786 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.924007 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.924301 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.945263 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:26.946487 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:26.954432 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1449/2884] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:26.958583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:26.968045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d8d7d-0c5c-4bef-b1fc-cd5f132a7b0e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:26.972583 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:26.973169 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.973444 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.973720 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.974407 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:31:26.974709 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:26.976821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:26.988523 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1436/2885] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:31:26.992775 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.002193 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab059f9-396f-4246-903f-56ea352b240f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.007576 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.008254 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.008537 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.008837 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.009458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.011414 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.037703 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1450/2886] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:26 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:27.042351 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.052544 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f5246-e40e-4c5a-800a-af660aa047c9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.107310 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.107952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.108209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.108479 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.109117 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.111045 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.132108 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1437/2887] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:27 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:31:27.136514 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.148435 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962420c2-a0e6-4359-883c-f3c756a68345 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.153420 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.154052 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.154329 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.154604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.155240 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.156844 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.167337 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1451/2888] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:27.171432 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.185791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc36c-5d16-406a-85b7-fffca1be618e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.192158 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fca108-7800-4a25-9cb9-ceaf5247aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.192745 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fca108-7800-4a25-9cb9-ceaf5247aff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.193024 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fca108-7800-4a25-9cb9-ceaf5247aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.193294 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fca108-7800-4a25-9cb9-ceaf5247aff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.193968 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fca108-7800-4a25-9cb9-ceaf5247aff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.195563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fca108-7800-4a25-9cb9-ceaf5247aff6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.206277 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1438/2889] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:27.210404 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.221003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397618-de21-4098-96e5-ae498b76dd91 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.225653 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.226324 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.226601 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.226869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] PATH_INFO: `/v3/projects/c96d5aabc2c14b14939b5357627813d8/users/8e29ad7d9b9445e6aebddd8b1a9b0144/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.241704 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96d5aabc2c14b14939b5357627813d8, user_id=8e29ad7d9b9445e6aebddd8b1a9b0144, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.244368 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.257168 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1452/2890] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:27 2022] PUT /identity/v3/projects/c96d5aabc2c14b14939b5357627813d8/users/8e29ad7d9b9445e6aebddd8b1a9b0144/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:27.269252 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.269532 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.269832 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.297661 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] MFA Rules not processed for user `8e29ad7d9b9445e6aebddd8b1a9b0144`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:27.298900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:27.302738 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:27.363964 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1439/2891] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:27.368397 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.427346 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c4f0-3778-413a-a184-bcf7b88de4c5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.431956 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.432547 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.432822 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.433090 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.433715 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.435645 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.462158 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1453/2892] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:27 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:27.466063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.477018 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394b892-3648-4cec-bdb5-40fbb1cc9b90 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.532313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.532906 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.533179 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.533447 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.534628 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.536520 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.557013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1440/2893] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:27 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:27.561003 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.571170 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe97371-0a85-4811-9b6d-ea928f04a106 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.575780 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.576365 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.576644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.576912 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.577548 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.579169 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.590344 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1454/2894] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:27.594264 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.604490 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c07b02-79e6-4c8f-a080-aeb04de9dc09 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.608997 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.609624 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.609935 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.610209 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] PATH_INFO: `/v3/projects/b5dec7a2d1ea45e09648030990ce6770/users/5422a5eab5af476190e2d038832d4482/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.624482 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dec7a2d1ea45e09648030990ce6770, user_id=5422a5eab5af476190e2d038832d4482, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.627152 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.639246 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1441/2895] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:27 2022] PUT /identity/v3/projects/b5dec7a2d1ea45e09648030990ce6770/users/5422a5eab5af476190e2d038832d4482/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:27.642996 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.653282 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5939-e028-403b-9cb7-db3f486c030f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.707268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95828-11f4-4048-b966-f12116240546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.707861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95828-11f4-4048-b966-f12116240546 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.708144 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95828-11f4-4048-b966-f12116240546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.708419 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95828-11f4-4048-b966-f12116240546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.709043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95828-11f4-4048-b966-f12116240546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.710787 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95828-11f4-4048-b966-f12116240546 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.723326 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1455/2896] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:27.724582 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.735035 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38af800-bef5-4f53-8f81-6873a1248502 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.740321 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.740959 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.741238 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.741514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] PATH_INFO: `/v3/projects/b5dec7a2d1ea45e09648030990ce6770/users/5422a5eab5af476190e2d038832d4482/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.743466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dec7a2d1ea45e09648030990ce6770, user_id=5422a5eab5af476190e2d038832d4482, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.746119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.756724 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1442/2897] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:27 2022] PUT /identity/v3/projects/b5dec7a2d1ea45e09648030990ce6770/users/5422a5eab5af476190e2d038832d4482/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:27.766909 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.767398 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.767513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.774534 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:27.796084 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] MFA Rules not processed for user `5422a5eab5af476190e2d038832d4482`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:27.797274 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:27.864693 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1456/2898] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:27.875797 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:27.878032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:27.933501 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bed8f-2ddf-4b40-bfa3-85f35e781d06 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:27.937233 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77609def-ef8b-4c96-8759-f5cacda61d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:27.937821 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609def-ef8b-4c96-8759-f5cacda61d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:27.938134 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609def-ef8b-4c96-8759-f5cacda61d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:27.938405 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609def-ef8b-4c96-8759-f5cacda61d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:27.947787 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77609def-ef8b-4c96-8759-f5cacda61d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:27.949268 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77609def-ef8b-4c96-8759-f5cacda61d68 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:27.954425 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:27.959967 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1443/2899] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:27.987840 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:28.048734 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73186b4-dc90-40c0-87f3-7ea00a028317 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:28.053434 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:28.054078 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:28.054357 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:28.054628 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] PATH_INFO: `/v3/users/8e29ad7d9b9445e6aebddd8b1a9b0144` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:28.055743 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e29ad7d9b9445e6aebddd8b1a9b0144)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:28.057652 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:28.102446 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e29ad7d9b9445e6aebddd8b1a9b0144'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.109504 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e29ad7d9b9445e6aebddd8b1a9b0144'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.121027 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e29ad7d9b9445e6aebddd8b1a9b0144'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.121679 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e29ad7d9b9445e6aebddd8b1a9b0144'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.128953 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e29ad7d9b9445e6aebddd8b1a9b0144'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.134685 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1457/2900] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:27 2022] DELETE /identity/v3/users/8e29ad7d9b9445e6aebddd8b1a9b0144 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:28.139101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:28.139389 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:28.139671 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:28.158807 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:28.160009 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:28.217219 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1444/2901] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:28.229625 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:28.231011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:28.241226 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:28.289945 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe16c1f-c9b1-4abf-bc6d-d83797dccd18 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:28.293602 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:28.294695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:28.294695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:28.294908 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:28.304450 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:28.305901 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:28.315630 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1458/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:28.579970 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:28.581932 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:28.594104 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98df782-265d-4011-9429-57e05f90ef9d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:28.598936 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:28.599639 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:28.600002 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:28.600271 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] PATH_INFO: `/v3/projects/c96d5aabc2c14b14939b5357627813d8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:28.601905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96d5aabc2c14b14939b5357627813d8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:28.604001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:28.649615 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96d5aabc2c14b14939b5357627813d8', 'request_id': 'req-22c3810f-8900-4613-b728-4bf8a3c57177'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.655816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96d5aabc2c14b14939b5357627813d8', 'request_id': 'req-22c3810f-8900-4613-b728-4bf8a3c57177'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.661643 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96d5aabc2c14b14939b5357627813d8', 'request_id': 'req-22c3810f-8900-4613-b728-4bf8a3c57177'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.674177 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] The token cache is being invalidate because project c96d5aabc2c14b14939b5357627813d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:28.675031 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.675801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.677347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1445/2903] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:28 2022] DELETE /identity/v3/projects/c96d5aabc2c14b14939b5357627813d8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:28.681293 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:28.690825 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4692f-f92d-4b91-b287-8485685a4eff service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:28.747737 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:28.748367 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:28.748671 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:28.748944 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] PATH_INFO: `/v3/users/5422a5eab5af476190e2d038832d4482` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:28.750117 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5422a5eab5af476190e2d038832d4482)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:28.752177 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:28.799847 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5422a5eab5af476190e2d038832d4482'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.806458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5422a5eab5af476190e2d038832d4482'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.819292 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5422a5eab5af476190e2d038832d4482'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.819962 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5422a5eab5af476190e2d038832d4482'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.826677 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-42ea0c28-791e-4d66-b3d9-65e884a7d392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5422a5eab5af476190e2d038832d4482'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:28.833026 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1459/2904] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:28 2022] DELETE /identity/v3/users/5422a5eab5af476190e2d038832d4482 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:29.107292 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.108755 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:29.131829 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3810f-8900-4613-b728-4bf8a3c57177 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.186579 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.187236 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.187519 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.187791 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] PATH_INFO: `/v3/projects/b5dec7a2d1ea45e09648030990ce6770` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.188920 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dec7a2d1ea45e09648030990ce6770)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.190948 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.225881 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:29.242166 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dec7a2d1ea45e09648030990ce6770', 'request_id': 'req-0203c8e1-cb40-41e0-a73c-7199102fa68a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:29.248347 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dec7a2d1ea45e09648030990ce6770', 'request_id': 'req-0203c8e1-cb40-41e0-a73c-7199102fa68a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:29.254269 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dec7a2d1ea45e09648030990ce6770', 'request_id': 'req-0203c8e1-cb40-41e0-a73c-7199102fa68a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:29.266311 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] The token cache is being invalidate because project b5dec7a2d1ea45e09648030990ce6770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:29.266594 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:29.267276 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0203c8e1-cb40-41e0-a73c-7199102fa68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:29.269281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1446/2905] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:29 2022] DELETE /identity/v3/projects/b5dec7a2d1ea45e09648030990ce6770 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:29.274255 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.274540 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.274806 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.294697 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:29.295811 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:29.318729 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:29.354977 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1460/2906] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:29.362774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.363056 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.363324 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.383081 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:29.384265 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:29.391971 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1447/2907] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:29.396647 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.406279 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd4ac1-8841-4103-ba83-6e7af54ac8b4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.410861 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.411445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.411726 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.412001 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.412660 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:31:29.412943 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.414819 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.426307 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1461/2908] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 31 00:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:31:29.430493 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.439592 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29aa3b-8abe-4f1c-b1ea-84ce283794fc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.444952 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.445528 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.445801 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.446101 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.446757 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.448830 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.476212 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1448/2909] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:29.480516 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.490374 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb8ae-43ec-4698-8529-aa0fbab335c5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.546119 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.546644 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.546924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.547199 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.547828 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.549735 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.570857 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1462/2910] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:29.575012 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.585241 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd80ccd-fdc9-41cc-8e64-edb164de0e63 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.589965 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.590586 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.590866 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.591140 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.591778 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.593401 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.603688 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1449/2911] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:29.607445 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.617741 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751733f-4579-4773-a616-1097e9dd8ba5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.622405 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532053f-c034-464e-a083-834e2756aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.622990 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532053f-c034-464e-a083-834e2756aa05 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.623270 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532053f-c034-464e-a083-834e2756aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.623544 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532053f-c034-464e-a083-834e2756aa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.624180 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532053f-c034-464e-a083-834e2756aa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.625774 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532053f-c034-464e-a083-834e2756aa05 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.636467 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1463/2912] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:29.640470 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.650280 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7155-7ede-4fc1-a036-0b2827f0bc2e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.654900 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.655538 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.655814 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.656087 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] PATH_INFO: `/v3/projects/94e10ee891a94ee085f7882d12f52765/users/4632f32e4af146c1a63eab7ab9cd29f5/roles/cd08b79af819428e9e3cdde76343f11e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.670816 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e10ee891a94ee085f7882d12f52765, user_id=4632f32e4af146c1a63eab7ab9cd29f5, role_id=cd08b79af819428e9e3cdde76343f11e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.673453 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.686370 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1450/2913] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:29 2022] PUT /identity/v3/projects/94e10ee891a94ee085f7882d12f52765/users/4632f32e4af146c1a63eab7ab9cd29f5/roles/cd08b79af819428e9e3cdde76343f11e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:31:29.697458 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.697771 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.698068 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.725615 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] MFA Rules not processed for user `4632f32e4af146c1a63eab7ab9cd29f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:29.726853 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:29.788725 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1464/2914] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:29.793228 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.852795 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d49b-515c-4304-bf9c-14f598439eef admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.857320 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.857958 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.858239 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.858510 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.859131 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.861043 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.890357 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1451/2915] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:29.894631 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:29.905147 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3022-d5f2-4967-9b65-d1e41faf5cc0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:29.925381 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:29.962216 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:29.962818 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:29.963099 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:29.963372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:29.964011 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:29.965947 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:29.986123 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1465/2916] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 31 00:31:29 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:31:29.990706 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:30.000728 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ac01b-c707-4dfe-a9b7-b9336dc974db admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:30.005548 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:30.006281 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.006563 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.006862 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.007503 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:30.009098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:30.019999 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1452/2917] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:31:30.024000 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:30.033860 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292c04a-dcf2-49b3-9a8a-9ab946726ab6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:30.038730 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:30.039376 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.039654 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.039924 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] PATH_INFO: `/v3/projects/1500cf4fd6ab40b7875e22a8c2fc2d27/users/d1a247e322a74f889a765baedf51b812/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.054578 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1500cf4fd6ab40b7875e22a8c2fc2d27, user_id=d1a247e322a74f889a765baedf51b812, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:30.057224 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:30.071097 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1466/2918] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:30 2022] PUT /identity/v3/projects/1500cf4fd6ab40b7875e22a8c2fc2d27/users/d1a247e322a74f889a765baedf51b812/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:30.075001 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:30.084756 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940456a9-cfa6-4a70-b59e-4d33355af3cf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:30.104244 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:30.141721 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c520cd-8f1e-48a8-8bd2-88f3bb8225f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:30.142498 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c520cd-8f1e-48a8-8bd2-88f3bb8225f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.142608 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c520cd-8f1e-48a8-8bd2-88f3bb8225f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.142869 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c520cd-8f1e-48a8-8bd2-88f3bb8225f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.143598 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c520cd-8f1e-48a8-8bd2-88f3bb8225f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:30.145225 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c520cd-8f1e-48a8-8bd2-88f3bb8225f6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:30.154843 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1453/2919] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 31 00:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:31:30.159495 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:30.169832 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1017b-2537-4371-b8cb-42d530d95734 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:30.174974 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:30.175620 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.175895 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.176163 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] PATH_INFO: `/v3/projects/1500cf4fd6ab40b7875e22a8c2fc2d27/users/d1a247e322a74f889a765baedf51b812/roles/7c753c584d524b31b4742805d7365f68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.178088 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1500cf4fd6ab40b7875e22a8c2fc2d27, user_id=d1a247e322a74f889a765baedf51b812, role_id=7c753c584d524b31b4742805d7365f68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:30.180713 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:30.190892 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1467/2920] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 31 00:31:30 2022] PUT /identity/v3/projects/1500cf4fd6ab40b7875e22a8c2fc2d27/users/d1a247e322a74f889a765baedf51b812/roles/7c753c584d524b31b4742805d7365f68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:30.200833 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.201120 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.201404 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.228761 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] MFA Rules not processed for user `d1a247e322a74f889a765baedf51b812`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:30.230004 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:30.301483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1454/2921] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:30.311987 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:30.313869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:30.370160 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d211-53b8-4800-ac2d-1106a8254e75 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:30.373695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b48a1-5823-4de5-b542-c30b2f454d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2440b4168f446639c4dd3761ea57438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:30.374316 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b48a1-5823-4de5-b542-c30b2f454d45 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.374594 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b48a1-5823-4de5-b542-c30b2f454d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.374863 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b48a1-5823-4de5-b542-c30b2f454d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.383597 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b48a1-5823-4de5-b542-c30b2f454d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:30.385017 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b48a1-5823-4de5-b542-c30b2f454d45 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:30.394238 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1468/2922] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:30.765462 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:30.826355 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbd7e8-d65a-4134-954d-65d98593a8d0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:30.830851 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:30.831464 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.831742 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.832015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] PATH_INFO: `/v3/users/4632f32e4af146c1a63eab7ab9cd29f5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.833122 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4632f32e4af146c1a63eab7ab9cd29f5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:30.835063 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:30.881689 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4632f32e4af146c1a63eab7ab9cd29f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:30.882313 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4632f32e4af146c1a63eab7ab9cd29f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:30.882933 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4632f32e4af146c1a63eab7ab9cd29f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:30.884154 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:30.896459 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4632f32e4af146c1a63eab7ab9cd29f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:30.904293 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4632f32e4af146c1a63eab7ab9cd29f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:30.917774 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1455/2923] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:30 2022] DELETE /identity/v3/users/4632f32e4af146c1a63eab7ab9cd29f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:30.922485 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:30.922950 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:30.923055 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:30.941659 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] MFA Rules not processed for user `35b61985750d49d482576c7757bd67fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:30.942869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:30.999493 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1469/2924] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 31 00:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:31.010879 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:31.012440 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:31.069015 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5802-8e0a-4fd9-bcf3-a71272d56d0e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:31.072629 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f83352aa0c3843e09f2a666b753a7b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:31.073237 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:31.073514 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:31.073783 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:31.082596 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:31.084032 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:31.093289 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1456/2925] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:31.362188 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:31.363604 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:31.375372 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0ab9-bd37-46f2-94b8-c3fbb3810e62 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:31.380220 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:31.380858 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:31.381135 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:31.381407 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] PATH_INFO: `/v3/projects/94e10ee891a94ee085f7882d12f52765` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:31.382656 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e10ee891a94ee085f7882d12f52765)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:31.385402 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:31.401695 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:31.433896 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e10ee891a94ee085f7882d12f52765', 'request_id': 'req-397410de-ec6e-4c11-abb1-78ea28b6fdc0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.440043 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e10ee891a94ee085f7882d12f52765', 'request_id': 'req-397410de-ec6e-4c11-abb1-78ea28b6fdc0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.445494 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e10ee891a94ee085f7882d12f52765', 'request_id': 'req-397410de-ec6e-4c11-abb1-78ea28b6fdc0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.462616 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] The token cache is being invalidate because project 94e10ee891a94ee085f7882d12f52765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:31.462952 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.463566 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.465042 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1470/2926] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:31 2022] DELETE /identity/v3/projects/94e10ee891a94ee085f7882d12f52765 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:31.469059 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:31.479266 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929399-0713-4792-a599-9ea0f1eaa434 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:31.536203 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:31.536820 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:31.537096 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:31.537365 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] PATH_INFO: `/v3/users/d1a247e322a74f889a765baedf51b812` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:31.538483 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a247e322a74f889a765baedf51b812)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:31.540649 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:31.584809 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a247e322a74f889a765baedf51b812'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.585465 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a247e322a74f889a765baedf51b812'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.586098 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a247e322a74f889a765baedf51b812'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.597515 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a247e322a74f889a765baedf51b812'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.600960 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:31.604926 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a247e322a74f889a765baedf51b812'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:31.619856 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1457/2927] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:31 2022] DELETE /identity/v3/users/d1a247e322a74f889a765baedf51b812 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:31.885933 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:31.887332 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:31.900791 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397410de-ec6e-4c11-abb1-78ea28b6fdc0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:31.960869 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b61985750d49d482576c7757bd67fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd522a8547c94161b0d64079ee82f079', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:31.961513 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:31.961769 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:31.962079 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] PATH_INFO: `/v3/projects/1500cf4fd6ab40b7875e22a8c2fc2d27` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:31.963268 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1500cf4fd6ab40b7875e22a8c2fc2d27)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:31.965139 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:32.010044 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1500cf4fd6ab40b7875e22a8c2fc2d27', 'request_id': 'req-ba12ba96-2ca8-45ae-9443-580ebf18306c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:32.015959 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1500cf4fd6ab40b7875e22a8c2fc2d27', 'request_id': 'req-ba12ba96-2ca8-45ae-9443-580ebf18306c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:32.021965 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1500cf4fd6ab40b7875e22a8c2fc2d27', 'request_id': 'req-ba12ba96-2ca8-45ae-9443-580ebf18306c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:32.034100 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] The token cache is being invalidate because project 1500cf4fd6ab40b7875e22a8c2fc2d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:32.034390 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:32.035010 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ba12ba96-2ca8-45ae-9443-580ebf18306c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:32.036459 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1471/2928] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:31 2022] DELETE /identity/v3/projects/1500cf4fd6ab40b7875e22a8c2fc2d27 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:41.616531 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:42.031098 dv-cinder-852209-8-iscsi devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:17.130042 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:17.131466 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:17.199595 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf81db-7ee3-465f-8be8-8b24ba73d96c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:17.256119 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454c3f093d8d465294f2b0fe786a1fa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b78c4cbce72543de99f295f9c19f6b68', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:17.256718 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:17.256993 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:17.257270 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:17.259013 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:17.270423 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:17.271983 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439b0e5-ee62-4928-a9a5-8b26768a48b6 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:17.281905 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1458/2929] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 31 00:33:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:33:27.277694 dv-cinder-852209-8-iscsi devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=58 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}